Search Results for author: Yangqiu Song

Found 148 papers, 105 papers with code

EventGround: Narrative Reasoning by Grounding to Eventuality-centric Knowledge Graphs

1 code implementation30 Mar 2024 Cheng Jiayang, Lin Qiu, Chunkit Chan, Xin Liu, Yangqiu Song, Zheng Zhang

In this work, we propose an initial comprehensive framework called EventGround, which aims to tackle the problem of grounding free-texts to eventuality-centric KGs for contextualized narrative reasoning.

Knowledge Graphs Language Modelling +2

Meta Operator for Complex Query Answering on Knowledge Graphs

no code implementations15 Mar 2024 Hang Yin, ZiHao Wang, Yangqiu Song

To answer complex queries under incomplete knowledge, learning-based Complex Query Answering (CQA) models are proposed to directly learn from the query-answer samples to avoid the direct traversal of incomplete graph data.

Complex Query Answering Meta-Learning +1

Complex Reasoning over Logical Queries on Commonsense Knowledge Graphs

no code implementations12 Mar 2024 Tianqing Fang, Zeming Chen, Yangqiu Song, Antoine Bosselut

Event commonsense reasoning requires the ability to reason about the relationship between events, as well as infer implicit context underlying that relationship.

Knowledge Graphs Multiple-choice +2

Soft Reasoning on Uncertain Knowledge Graphs

no code implementations3 Mar 2024 Weizhi Fei, ZiHao Wang, Hang Yin, Yang Duan, Hanghang Tong, Yangqiu Song

To bridge this gap, we study the setting of soft queries on uncertain knowledge, which is motivated by the establishment of soft constraint programming.

Knowledge Graphs

Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?

no code implementations28 Feb 2024 Qineng Wang, ZiHao Wang, Ying Su, Hanghang Tong, Yangqiu Song

Recent progress in LLMs discussion suggests that multi-agent discussion improves the reasoning abilities of LLMs.

MIKO: Multimodal Intention Knowledge Distillation from Large Language Models for Social-Media Commonsense Discovery

no code implementations28 Feb 2024 Feihong Lu, Weiqi Wang, Yangyifei Luo, Ziqin Zhu, Qingyun Sun, Baixuan Xu, Haochen Shi, Shiqi Gao, Qian Li, Yangqiu Song, JianXin Li

However, understanding the intention behind social media posts remains challenging due to the implicitness of intentions in social media posts, the need for cross-modality understanding of both text and images, and the presence of noisy information such as hashtags, misspelled words, and complicated abbreviations.

Knowledge Distillation Language Modelling +2

FedCQA: Answering Complex Queries on Multi-Source Knowledge Graphs via Federated Learning

no code implementations22 Feb 2024 Qi Hu, Weifeng Jiang, Haoran Li, ZiHao Wang, Jiaxin Bai, Qianren Mao, Yangqiu Song, Lixin Fan, JianXin Li

An entity can be involved in various knowledge graphs and reasoning on multiple KGs and answering complex queries on multi-source KGs is important in discovering knowledge cross graphs.

Complex Query Answering Federated Learning +2

EntailE: Introducing Textual Entailment in Commonsense Knowledge Graph Completion

no code implementations15 Feb 2024 Ying Su, Tianqing Fang, Huiru Xiao, Weiqi Wang, Yangqiu Song, Tong Zhang, Lei Chen

In this paper, we propose to adopt textual entailment to find implicit entailment relations between CSKG nodes, to effectively densify the subgraph connecting nodes within the same conceptual class, which indicates a similar level of plausibility.

graph construction Knowledge Graph Embedding +1

PipeNet: Question Answering with Semantic Pruning over Knowledge Graphs

no code implementations31 Jan 2024 Ying Su, Jipeng Zhang, Yangqiu Song, Tong Zhang

To facilitate the evaluation of pruned subgraphs, we also propose a graph attention network (GAT) based module to reason with the subgraph data.

Graph Attention Knowledge Graphs +1

ConstraintChecker: A Plugin for Large Language Models to Reason on Commonsense Knowledge Bases

1 code implementation25 Jan 2024 Quyet V. Do, Tianqing Fang, Shizhe Diao, Zhaowei Wang, Yangqiu Song

When considering a new knowledge instance, ConstraintChecker employs a rule-based module to produce a list of constraints, then it uses a zero-shot learning module to check whether this knowledge instance satisfies all constraints.

Prompt Engineering Zero-Shot Learning

CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense Reasoning

1 code implementation14 Jan 2024 Weiqi Wang, Tianqing Fang, Chunyang Li, Haochen Shi, Wenxuan Ding, Baixuan Xu, Zhaowei Wang, Jiaxin Bai, Xin Liu, Jiayang Cheng, Chunkit Chan, Yangqiu Song

The sequential process of conceptualization and instantiation is essential to generalizable commonsense reasoning as it allows the application of existing knowledge to unfamiliar scenarios.

Privacy-Preserved Neural Graph Databases

no code implementations25 Dec 2023 Qi Hu, Haoran Li, Jiaxin Bai, ZiHao Wang, Yangqiu Song

Neural graph databases (NGDBs) have emerged as a powerful paradigm that combines the strengths of graph databases (GDBs) and neural networks to enable efficient storage, retrieval, and analysis of graph-structured data which can be adaptively trained with LLMs.

Privacy Preserving Retrieval

Advancing Abductive Reasoning in Knowledge Graphs through Complex Logical Hypothesis Generation

no code implementations25 Dec 2023 Jiaxin Bai, Yicheng Wang, Tianshi Zheng, Yue Guo, Xin Liu, Yangqiu Song

Although many applications require the use of knowledge for explanations, the utilization of abductive reasoning in conjunction with structured knowledge, such as a knowledge graph, remains largely unexplored.

Knowledge Graphs Logical Reasoning

Enhancing User Intent Capture in Session-Based Recommendation with Attribute Patterns

1 code implementation NeurIPS 2023 Xin Liu, Zheng Li, Yifan Gao, Jingfeng Yang, Tianyu Cao, Zhengyang Wang, Bing Yin, Yangqiu Song

The goal of session-based recommendation in E-commerce is to predict the next item that an anonymous user will purchase based on the browsing and purchase history.

Attribute Session-Based Recommendations

User Consented Federated Recommender System Against Personalized Attribute Inference Attack

1 code implementation23 Dec 2023 Qi Hu, Yangqiu Song

However, the recommendation model learned by a common FedRec may still be vulnerable to private information leakage risks, particularly attribute inference attacks, which means that the attacker can easily infer users' personal attributes from the learned model.

Attribute Federated Learning +2

Understanding Inter-Session Intentions via Complex Logical Reasoning

no code implementations21 Dec 2023 Jiaxin Bai, Chen Luo, Zheng Li, Qingyu Yin, Yangqiu Song

In this paper, we introduce the task of logical session complex query answering, where sessions are treated as hyperedges of items, and we formulate the problem of complex intention understanding as a task of logical session complex queries answering (LS-CQA) on an aggregated hypergraph of sessions, items, and attributes.

Attribute Complex Query Answering +1

AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graph

1 code implementation15 Nov 2023 Zhaowei Wang, Haochen Shi, Weiqi Wang, Tianqing Fang, Hongming Zhang, Sehyun Choi, Xin Liu, Yangqiu Song

Cognitive research indicates that abstraction ability is essential in human intelligence, which remains under-explored in language models.


P-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models

no code implementations7 Nov 2023 Haoran Li, Dadi Guo, Donghao Li, Wei Fan, Qi Hu, Xin Liu, Chunkit Chan, Duanyi Yao, Yangqiu Song

Lastly, P-Bench performs existing privacy attacks on LMs with pre-defined privacy objectives as the empirical evaluation results.

Privacy Preserving

Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observations

1 code implementation31 Oct 2023 Nuo Chen, Zinan Zheng, Ning Wu, Ming Gong, Yangqiu Song, Dongmei Zhang, Jia Li

This indicates that crafting multilingual corpora can be regarded as a vital strategy for enhancing model performance in a specific language, especially in mathematical reasoning tasks.

GSM8K Math +1

Chain-of-Choice Hierarchical Policy Learning for Conversational Recommendation

1 code implementation27 Oct 2023 Wei Fan, Weijia Zhang, Weiqi Wang, Yangqiu Song, Hao liu

Conversational Recommender Systems (CRS) illuminate user preferences via multi-round interactive dialogues, ultimately navigating towards precise and satisfactory recommendations.

Attribute Hierarchical Reinforcement Learning +1

Gold: A Global and Local-aware Denoising Framework for Commonsense Knowledge Graph Noise Detection

1 code implementation18 Oct 2023 Zheye Deng, Weiqi Wang, Zhaowei Wang, Xin Liu, Yangqiu Song

Commonsense Knowledge Graphs (CSKGs) are crucial for commonsense reasoning, yet constructing them through human annotations can be costly.

Denoising Knowledge Graphs +1

QADYNAMICS: Training Dynamics-Driven Synthetic QA Diagnostic for Zero-Shot Commonsense Question Answering

1 code implementation17 Oct 2023 Haochen Shi, Weiqi Wang, Tianqing Fang, Baixuan Xu, Wenxuan Ding, Xin Liu, Yangqiu Song

Zero-shot commonsense Question-Answering (QA) requires models to reason about general situations beyond specific benchmarks.

Question Answering

Privacy in Large Language Models: Attacks, Defenses and Future Directions

no code implementations16 Oct 2023 Haoran Li, Yulin Chen, Jinglong Luo, Yan Kang, Xiaojin Zhang, Qi Hu, Chunkit Chan, Yangqiu Song

The advancement of large language models (LLMs) has significantly enhanced the ability to effectively tackle various downstream NLP tasks and unify these tasks into generative pipelines.

Self-Consistent Narrative Prompts on Abductive Natural Language Inference

1 code implementation15 Sep 2023 Chunkit Chan, Xin Liu, Tsz Ho Chan, Jiayang Cheng, Yangqiu Song, Ginny Wong, Simon See

However, the inter-sentential coherence and the model consistency have not been well exploited in the previous works on this task.

Language Modelling Natural Language Inference

Independent Distribution Regularization for Private Graph Embedding

1 code implementation16 Aug 2023 Qi Hu, Yangqiu Song

Additionally, we introduce a novel regularization to enforce the independence of the encoders.

Attribute Graph Embedding +5

Knowledge Graph Reasoning over Entities and Numerical Values

1 code implementation2 Jun 2023 Jiaxin Bai, Chen Luo, Zheng Li, Qingyu Yin, Bing Yin, Yangqiu Song

To address the difference between entities and numerical values, we also propose the framework of Number Reasoning Network (NRN) for alternatively encoding entities and numerical values into separate encoding structures.

Attribute Complex Query Answering

Getting Sick After Seeing a Doctor? Diagnosing and Mitigating Knowledge Conflicts in Event Temporal Reasoning

no code implementations24 May 2023 Tianqing Fang, Zhaowei Wang, Wenxuan Zhou, Hongming Zhang, Yangqiu Song, Muhao Chen

However, knowledge conflicts arise when there is a mismatch between the actual temporal relations of events in the context and the prior knowledge or biases learned by the model.

counterfactual Data Augmentation +2

CAR: Conceptualization-Augmented Reasoner for Zero-Shot Commonsense Question Answering

1 code implementation24 May 2023 Weiqi Wang, Tianqing Fang, Wenxuan Ding, Baixuan Xu, Xin Liu, Yangqiu Song, Antoine Bosselut

The task of zero-shot commonsense question answering evaluates models on their capacity to reason about general scenarios beyond those presented in specific datasets.

Question Answering

CCGen: Explainable Complementary Concept Generation in E-Commerce

no code implementations19 May 2023 Jie Huang, Yifan Gao, Zheng Li, Jingfeng Yang, Yangqiu Song, Chao Zhang, Zining Zhu, Haoming Jiang, Kevin Chen-Chuan Chang, Bing Yin

We propose and study Complementary Concept Generation (CCGen): given a concept of interest, e. g., "Digital Cameras", generating a list of complementary concepts, e. g., 1) Camera Lenses 2) Batteries 3) Camera Cases 4) Memory Cards 5) Battery Chargers.

COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspective

1 code implementation9 May 2023 Zhaowei Wang, Quyet V. Do, Hongming Zhang, Jiayao Zhang, Weiqi Wang, Tianqing Fang, Yangqiu Song, Ginny Y. Wong, Simon See

This paper proposes a new task to detect commonsense causation between two events in an event sequence (i. e., context), called contextualized commonsense causal reasoning.

Causal Inference CoLA +1

CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning

2 code implementations8 May 2023 Weiqi Wang, Tianqing Fang, Baixuan Xu, Chun Yi Louis Bo, Yangqiu Song, Lei Chen

Commonsense reasoning, aiming at endowing machines with a human-like ability to make situational presumptions, is extremely challenging to generalize.

Wasserstein-Fisher-Rao Embedding: Logical Query Embeddings with Local Comparison and Global Transport

1 code implementation6 May 2023 ZiHao Wang, Weizhi Fei, Hang Yin, Yangqiu Song, Ginny Y. Wong, Simon See

In contrast to existing scoring functions motivated by local comparison or global transport, this work investigates the local and global trade-off with unbalanced optimal transport theory.

Knowledge Graphs Logical Reasoning

DiscoPrompt: Path Prediction Prompt Tuning for Implicit Discourse Relation Recognition

1 code implementation6 May 2023 Chunkit Chan, Xin Liu, Jiayang Cheng, Zihan Li, Yangqiu Song, Ginny Y. Wong, Simon See

Implicit Discourse Relation Recognition (IDRR) is a sophisticated and challenging task to recognize the discourse relations between the arguments with the absence of discourse connectives.

Relation text-classification +1

Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Recover the Whole Sentence

1 code implementation4 May 2023 Haoran Li, Mingshi Xu, Yangqiu Song

In this work, we further investigate the information leakage issue and propose a generative embedding inversion attack (GEIA) that aims to reconstruct input sequences based only on their sentence embeddings.

Language Modelling Sentence +2

ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relations

no code implementations28 Apr 2023 Chunkit Chan, Jiayang Cheng, Weiqi Wang, Yuxin Jiang, Tianqing Fang, Xin Liu, Yangqiu Song

This paper aims to quantitatively evaluate the performance of ChatGPT, an interactive large language model, on inter-sentential relations such as temporal relations, causal relations, and discourse relations.

Discourse Parsing In-Context Learning +6

CKBP v2: An Expert-Annotated Evaluation Set for Commonsense Knowledge Base Population

1 code implementation20 Apr 2023 Tianqing Fang, Quyet V. Do, Sehyun Choi, Weiqi Wang, Yangqiu Song

Populating Commonsense Knowledge Bases (CSKB) is an important yet hard task in NLP, as it tackles knowledge from external sources with unseen events and entities.

Knowledge Base Population

Rethinking Complex Queries on Knowledge Graphs with Neural Link Predictors

1 code implementation14 Apr 2023 Hang Yin, ZiHao Wang, Yangqiu Song

Moreover, we develop a new dataset containing ten new types of queries with features that have never been considered and therefore can provide a thorough investigation of complex queries.

Knowledge Graphs

Multi-step Jailbreaking Privacy Attacks on ChatGPT

1 code implementation11 Apr 2023 Haoran Li, Dadi Guo, Wei Fan, Mingshi Xu, Jie Huang, Fanpu Meng, Yangqiu Song

With the rapid progress of large language models (LLMs), many downstream NLP tasks can be well solved given appropriate prompts.

Sequential Query Encoding For Complex Query Answering on Knowledge Graphs

1 code implementation25 Feb 2023 Jiaxin Bai, Tianshi Zheng, Yangqiu Song

Instead of parameterizing and executing the computational graph, SQE first uses a search-based algorithm to linearize the computational graph to a sequence of tokens and then uses a sequence encoder to compute its vector representation.

Complex Query Answering

Global Constraints with Prompting for Zero-Shot Event Argument Classification

1 code implementation9 Feb 2023 Zizheng Lin, Hongming Zhang, Yangqiu Song

In this work, we propose to use global constraints with prompting to effectively tackles event argument classification without any annotation and task-specific training.

Event Extraction Language Modelling

Logical Message Passing Networks with One-hop Inference on Atomic Formulas

1 code implementation21 Jan 2023 ZiHao Wang, Yangqiu Song, Ginny Y. Wong, Simon See

On top of the query graph, we propose the Logical Message Passing Neural Network (LMPNN) that connects the local one-hop inferences on atomic formulas to the global logical reasoning for complex query answering.

Complex Query Answering Graph Representation Learning +1

Complex Hyperbolic Knowledge Graph Embeddings with Fast Fourier Transform

1 code implementation7 Nov 2022 Huiru Xiao, Xin Liu, Yangqiu Song, Ginny Y. Wong, Simon See

However, the performance of the hyperbolic KG embedding models for non-transitive relations is still unpromising, while the complex hyperbolic embeddings do not deal with multi-relations.

Knowledge Graph Embeddings

BEKG: A Built Environment Knowledge Graph

1 code implementation5 Nov 2022 Xiaojun Yang, Haoyu Zhong, Penglin Du, Keyi Zhou, Xingjin Lai, Zhengdong Wang, Yik Lun Lau, Yangqiu Song, Liyaning Tang

In this paper, more than 80, 000 paper abstracts in the built environment field were obtained to build a knowledge graph, a knowledge base storing entities and their connective relations in a graph-structured data model.

named-entity-recognition Named Entity Recognition +3

Kuaipedia: a Large-scale Multi-modal Short-video Encyclopedia

1 code implementation28 Oct 2022 Haojie Pan, Zepeng Zhai, Yuzhou Zhang, Ruiji Fu, Ming Liu, Yangqiu Song, Zhongyuan Wang, Bing Qin

In this paper, we propose Kuaipedia, a large-scale multi-modal encyclopedia consisting of items, aspects, and short videos lined to them, which was extracted from billions of videos of Kuaishou (Kwai), a well-known short-video platform in China.

Entity Linking Entity Typing

An Empirical Revisiting of Linguistic Knowledge Fusion in Language Understanding Tasks

1 code implementation24 Oct 2022 Changlong Yu, Tianyi Xiao, Lingpeng Kong, Yangqiu Song, Wilfred Ng

Though linguistic knowledge emerges during large-scale language model pretraining, recent work attempt to explicitly incorporate human-defined linguistic priors into task-specific fine-tuning.

Language Modelling

MICO: A Multi-alternative Contrastive Learning Framework for Commonsense Knowledge Representation

1 code implementation14 Oct 2022 Ying Su, ZiHao Wang, Tianqing Fang, Hongming Zhang, Yangqiu Song, Tong Zhang

Commonsense reasoning tasks such as commonsense knowledge graph completion and commonsense question answering require powerful representation learning.

Contrastive Learning Question Answering +2

Multilingual Word Sense Disambiguation with Unified Sense Representation

1 code implementation COLING 2022 Ying Su, Hongming Zhang, Yangqiu Song, Tong Zhang

As a key natural language processing (NLP) task, word sense disambiguation (WSD) evaluates how well NLP models can understand the lexical semantics of words under specific contexts.

Word Sense Disambiguation

PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Population

1 code implementation14 Oct 2022 Tianqing Fang, Quyet V. Do, Hongming Zhang, Yangqiu Song, Ginny Y. Wong, Simon See

We propose PseudoReasoner, a semi-supervised learning framework for CSKB population that uses a teacher model pre-trained on CSKBs to provide pseudo labels on the unlabeled candidate dataset for a student model to learn from.

Domain Generalization Knowledge Base Population

SubeventWriter: Iterative Sub-event Sequence Generation with Coherence Controller

1 code implementation13 Oct 2022 Zhaowei Wang, Hongming Zhang, Tianqing Fang, Yangqiu Song, Ginny Y. Wong, Simon See

In this paper, we propose a new task of sub-event generation for an unseen process to evaluate the understanding of the coherence of sub-event actions and objects.

CIKQA: Learning Commonsense Inference with a Unified Knowledge-in-the-loop QA Paradigm

no code implementations12 Oct 2022 Hongming Zhang, Yintong Huo, Yanai Elazar, Yangqiu Song, Yoav Goldberg, Dan Roth

We first align commonsense tasks with relevant knowledge from commonsense knowledge bases and ask humans to annotate whether the knowledge is enough or not.

Question Answering Task 2

Cross-domain Cross-architecture Black-box Attacks on Fine-tuned Models with Transferred Evolutionary Strategies

1 code implementation28 Aug 2022 Yinghua Zhang, Yangqiu Song, Kun Bai, Qiang Yang

To successfully attack fine-tuned models under both settings, we propose to first train an adversarial generator against the source model, which adopts an encoder-decoder architecture and maps a clean input to an adversarial example.

Boosting Graph Structure Learning with Dummy Nodes

1 code implementation17 Jun 2022 Xin Liu, Jiayang Cheng, Yangqiu Song, Xin Jiang

We extend graph kernels and graph neural networks with dummy nodes and conduct experiments on graph classification and subgraph isomorphism matching tasks.

Graph Classification Graph Representation Learning +1

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

3 code implementations9 Jun 2022 Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang, Alicia Parrish, Allen Nie, Aman Hussain, Amanda Askell, Amanda Dsouza, Ambrose Slone, Ameet Rahane, Anantharaman S. Iyer, Anders Andreassen, Andrea Madotto, Andrea Santilli, Andreas Stuhlmüller, Andrew Dai, Andrew La, Andrew Lampinen, Andy Zou, Angela Jiang, Angelica Chen, Anh Vuong, Animesh Gupta, Anna Gottardi, Antonio Norelli, Anu Venkatesh, Arash Gholamidavoodi, Arfa Tabassum, Arul Menezes, Arun Kirubarajan, Asher Mullokandov, Ashish Sabharwal, Austin Herrick, Avia Efrat, Aykut Erdem, Ayla Karakaş, B. Ryan Roberts, Bao Sheng Loe, Barret Zoph, Bartłomiej Bojanowski, Batuhan Özyurt, Behnam Hedayatnia, Behnam Neyshabur, Benjamin Inden, Benno Stein, Berk Ekmekci, Bill Yuchen Lin, Blake Howald, Bryan Orinion, Cameron Diao, Cameron Dour, Catherine Stinson, Cedrick Argueta, César Ferri Ramírez, Chandan Singh, Charles Rathkopf, Chenlin Meng, Chitta Baral, Chiyu Wu, Chris Callison-Burch, Chris Waites, Christian Voigt, Christopher D. Manning, Christopher Potts, Cindy Ramirez, Clara E. Rivera, Clemencia Siro, Colin Raffel, Courtney Ashcraft, Cristina Garbacea, Damien Sileo, Dan Garrette, Dan Hendrycks, Dan Kilman, Dan Roth, Daniel Freeman, Daniel Khashabi, Daniel Levy, Daniel Moseguí González, Danielle Perszyk, Danny Hernandez, Danqi Chen, Daphne Ippolito, Dar Gilboa, David Dohan, David Drakard, David Jurgens, Debajyoti Datta, Deep Ganguli, Denis Emelin, Denis Kleyko, Deniz Yuret, Derek Chen, Derek Tam, Dieuwke Hupkes, Diganta Misra, Dilyar Buzan, Dimitri Coelho Mollo, Diyi Yang, Dong-Ho Lee, Dylan Schrader, Ekaterina Shutova, Ekin Dogus Cubuk, Elad Segal, Eleanor Hagerman, Elizabeth Barnes, Elizabeth Donoway, Ellie Pavlick, Emanuele Rodola, Emma Lam, Eric Chu, Eric Tang, Erkut Erdem, Ernie Chang, Ethan A. Chi, Ethan Dyer, Ethan Jerzak, Ethan Kim, Eunice Engefu Manyasi, Evgenii Zheltonozhskii, Fanyue Xia, Fatemeh Siar, Fernando Martínez-Plumed, Francesca Happé, Francois Chollet, Frieda Rong, Gaurav Mishra, Genta Indra Winata, Gerard de Melo, Germán Kruszewski, Giambattista Parascandolo, Giorgio Mariani, Gloria Wang, Gonzalo Jaimovitch-López, Gregor Betz, Guy Gur-Ari, Hana Galijasevic, Hannah Kim, Hannah Rashkin, Hannaneh Hajishirzi, Harsh Mehta, Hayden Bogar, Henry Shevlin, Hinrich Schütze, Hiromu Yakura, Hongming Zhang, Hugh Mee Wong, Ian Ng, Isaac Noble, Jaap Jumelet, Jack Geissinger, Jackson Kernion, Jacob Hilton, Jaehoon Lee, Jaime Fernández Fisac, James B. Simon, James Koppel, James Zheng, James Zou, Jan Kocoń, Jana Thompson, Janelle Wingfield, Jared Kaplan, Jarema Radom, Jascha Sohl-Dickstein, Jason Phang, Jason Wei, Jason Yosinski, Jekaterina Novikova, Jelle Bosscher, Jennifer Marsh, Jeremy Kim, Jeroen Taal, Jesse Engel, Jesujoba Alabi, Jiacheng Xu, Jiaming Song, Jillian Tang, Joan Waweru, John Burden, John Miller, John U. Balis, Jonathan Batchelder, Jonathan Berant, Jörg Frohberg, Jos Rozen, Jose Hernandez-Orallo, Joseph Boudeman, Joseph Guerr, Joseph Jones, Joshua B. Tenenbaum, Joshua S. Rule, Joyce Chua, Kamil Kanclerz, Karen Livescu, Karl Krauth, Karthik Gopalakrishnan, Katerina Ignatyeva, Katja Markert, Kaustubh D. Dhole, Kevin Gimpel, Kevin Omondi, Kory Mathewson, Kristen Chiafullo, Ksenia Shkaruta, Kumar Shridhar, Kyle McDonell, Kyle Richardson, Laria Reynolds, Leo Gao, Li Zhang, Liam Dugan, Lianhui Qin, Lidia Contreras-Ochando, Louis-Philippe Morency, Luca Moschella, Lucas Lam, Lucy Noble, Ludwig Schmidt, Luheng He, Luis Oliveros Colón, Luke Metz, Lütfi Kerem Şenel, Maarten Bosma, Maarten Sap, Maartje ter Hoeve, Maheen Farooqi, Manaal Faruqui, Mantas Mazeika, Marco Baturan, Marco Marelli, Marco Maru, Maria Jose Ramírez Quintana, Marie Tolkiehn, Mario Giulianelli, Martha Lewis, Martin Potthast, Matthew L. Leavitt, Matthias Hagen, Mátyás Schubert, Medina Orduna Baitemirova, Melody Arnaud, Melvin McElrath, Michael A. Yee, Michael Cohen, Michael Gu, Michael Ivanitskiy, Michael Starritt, Michael Strube, Michał Swędrowski, Michele Bevilacqua, Michihiro Yasunaga, Mihir Kale, Mike Cain, Mimee Xu, Mirac Suzgun, Mitch Walker, Mo Tiwari, Mohit Bansal, Moin Aminnaseri, Mor Geva, Mozhdeh Gheini, Mukund Varma T, Nanyun Peng, Nathan A. Chi, Nayeon Lee, Neta Gur-Ari Krakover, Nicholas Cameron, Nicholas Roberts, Nick Doiron, Nicole Martinez, Nikita Nangia, Niklas Deckers, Niklas Muennighoff, Nitish Shirish Keskar, Niveditha S. Iyer, Noah Constant, Noah Fiedel, Nuan Wen, Oliver Zhang, Omar Agha, Omar Elbaghdadi, Omer Levy, Owain Evans, Pablo Antonio Moreno Casares, Parth Doshi, Pascale Fung, Paul Pu Liang, Paul Vicol, Pegah Alipoormolabashi, Peiyuan Liao, Percy Liang, Peter Chang, Peter Eckersley, Phu Mon Htut, Pinyu Hwang, Piotr Miłkowski, Piyush Patil, Pouya Pezeshkpour, Priti Oli, Qiaozhu Mei, Qing Lyu, Qinlang Chen, Rabin Banjade, Rachel Etta Rudolph, Raefer Gabriel, Rahel Habacker, Ramon Risco, Raphaël Millière, Rhythm Garg, Richard Barnes, Rif A. Saurous, Riku Arakawa, Robbe Raymaekers, Robert Frank, Rohan Sikand, Roman Novak, Roman Sitelew, Ronan LeBras, Rosanne Liu, Rowan Jacobs, Rui Zhang, Ruslan Salakhutdinov, Ryan Chi, Ryan Lee, Ryan Stovall, Ryan Teehan, Rylan Yang, Sahib Singh, Saif M. Mohammad, Sajant Anand, Sam Dillavou, Sam Shleifer, Sam Wiseman, Samuel Gruetter, Samuel R. Bowman, Samuel S. Schoenholz, Sanghyun Han, Sanjeev Kwatra, Sarah A. Rous, Sarik Ghazarian, Sayan Ghosh, Sean Casey, Sebastian Bischoff, Sebastian Gehrmann, Sebastian Schuster, Sepideh Sadeghi, Shadi Hamdan, Sharon Zhou, Shashank Srivastava, Sherry Shi, Shikhar Singh, Shima Asaadi, Shixiang Shane Gu, Shubh Pachchigar, Shubham Toshniwal, Shyam Upadhyay, Shyamolima, Debnath, Siamak Shakeri, Simon Thormeyer, Simone Melzi, Siva Reddy, Sneha Priscilla Makini, Soo-Hwan Lee, Spencer Torene, Sriharsha Hatwar, Stanislas Dehaene, Stefan Divic, Stefano Ermon, Stella Biderman, Stephanie Lin, Stephen Prasad, Steven T. Piantadosi, Stuart M. Shieber, Summer Misherghi, Svetlana Kiritchenko, Swaroop Mishra, Tal Linzen, Tal Schuster, Tao Li, Tao Yu, Tariq Ali, Tatsu Hashimoto, Te-Lin Wu, Théo Desbordes, Theodore Rothschild, Thomas Phan, Tianle Wang, Tiberius Nkinyili, Timo Schick, Timofei Kornev, Titus Tunduny, Tobias Gerstenberg, Trenton Chang, Trishala Neeraj, Tushar Khot, Tyler Shultz, Uri Shaham, Vedant Misra, Vera Demberg, Victoria Nyamai, Vikas Raunak, Vinay Ramasesh, Vinay Uday Prabhu, Vishakh Padmakumar, Vivek Srikumar, William Fedus, William Saunders, William Zhang, Wout Vossen, Xiang Ren, Xiaoyu Tong, Xinran Zhao, Xinyi Wu, Xudong Shen, Yadollah Yaghoobzadeh, Yair Lakretz, Yangqiu Song, Yasaman Bahri, Yejin Choi, Yichi Yang, Yiding Hao, Yifu Chen, Yonatan Belinkov, Yu Hou, Yufang Hou, Yuntao Bai, Zachary Seid, Zhuoye Zhao, Zijian Wang, Zijie J. Wang, ZiRui Wang, Ziyi Wu

BIG-bench focuses on tasks that are believed to be beyond the capabilities of current language models.

Common Sense Reasoning Math +1

Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization

1 code implementation3 Jun 2022 Mutian He, Tianqing Fang, Weiqi Wang, Yangqiu Song

Conceptualization, or viewing entities and situations as instances of abstract concepts in mind and making inferences based on that, is a vital component in human intelligence for commonsense reasoning.

Knowledge Graphs

VD-PCR: Improving Visual Dialog with Pronoun Coreference Resolution

1 code implementation29 May 2022 Xintong Yu, Hongming Zhang, Ruixin Hong, Yangqiu Song, ChangShui Zhang

In this paper, we propose VD-PCR, a novel framework to improve Visual Dialog understanding with Pronoun Coreference Resolution in both implicit and explicit ways.

coreference-resolution Visual Dialog

Query2Particles: Knowledge Graph Reasoning with Particle Embeddings

1 code implementation Findings (NAACL) 2022 Jiaxin Bai, ZiHao Wang, Hongming Zhang, Yangqiu Song

The query embedding method is proposed to answer these queries by jointly encoding queries and entities to the same embedding space.

Complex Query Answering Entity Embeddings

Graph Convolutional Networks with Dual Message Passing for Subgraph Isomorphism Counting and Matching

1 code implementation16 Dec 2021 Xin Liu, Yangqiu Song

Based on this observation, we propose dual message passing neural networks (DMPNNs) to enhance the substructure representation learning in an asynchronous way for subgraph isomorphism counting and matching as well as unsupervised node classification.

Node Classification Representation Learning

Benchmarking the Combinatorial Generalizability of Complex Query Answering on Knowledge Graphs

2 code implementations18 Sep 2021 ZiHao Wang, Hang Yin, Yangqiu Song

Besides, our work, for the first time, provides a benchmark to evaluate and analyze the impact of different operators and normal forms by using (a) 7 choices of the operator systems and (b) 9 forms of complex queries.

Benchmarking Complex Query Answering

Multi-Relational Graph based Heterogeneous Multi-Task Learning in Community Question Answering

no code implementations4 Sep 2021 Zizheng Lin, Haowen Ke, Ngo-Yin Wong, Jiaxin Bai, Yangqiu Song, Huan Zhao, Junpeng Ye

To tackle this challenge, we develop a multi-relational graph based MTL model called Heterogeneous Multi-Task Graph Isomorphism Network (HMTGIN) which efficiently solves heterogeneous CQA tasks.

Community Question Answering Multi-Task Learning

Probing Toxic Content in Large Pre-Trained Language Models

1 code implementation ACL 2021 Nedjma Ousidhoum, Xinran Zhao, Tianqing Fang, Yangqiu Song, Dit-yan Yeung

Large pre-trained language models (PTLMs) have been shown to carry biases towards different social groups which leads to the reproduction of stereotypical and toxic content by major NLP systems.

Probing Language Models Sentence

Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model

1 code implementation ACL 2021 Hongliang Dai, Yangqiu Song, Haixun Wang

Recently, there is an effort to extend fine-grained entity typing by using a richer and ultra-fine set of types, and labeling noun phrases including pronouns and nominal nouns instead of just named entity mentions.

 Ranked #1 on Entity Typing on Ontonotes v5 (English) (using extra training data)

Entity Typing Language Modelling +1

Differentially Private Federated Knowledge Graphs Embedding

1 code implementation17 May 2021 Hao Peng, Haoran Li, Yangqiu Song, Vincent Zheng, JianXin Li

However, for multiple cross-domain knowledge graphs, state-of-the-art embedding models cannot make full use of the data from different knowledge domains while preserving the privacy of exchanged data.

Knowledge Graph Embedding Knowledge Graphs +4

Unit Ball Model for Embedding Hierarchical Structures in the Complex Hyperbolic Space

1 code implementation NeurIPS 2021 Huiru Xiao, Caigao Jiang, Yangqiu Song, James Zhang, Junwu Xiong

Specifically, we propose to learn the embeddings of hierarchically structured data in the unit ball model of the complex hyperbolic space.

Representation Learning

Variational Weakly Supervised Sentiment Analysis with Posterior Regularization

1 code implementation EACL 2021 Ziqian Zeng, Yangqiu Song

In this paper, we propose a posterior regularization framework for the variational approach to the weakly supervised sentiment analysis to better control the posterior distribution of the label assignment.

Sentiment Analysis

Fair Representation Learning for Heterogeneous Information Networks

1 code implementation18 Apr 2021 Ziqian Zeng, Rashidul Islam, Kamrun Naher Keya, James Foulds, Yangqiu Song, SHimei Pan

Recently, much attention has been paid to the societal impact of AI, especially concerns regarding its fairness.

Fairness Representation Learning

ASER: Towards Large-scale Commonsense Knowledge Acquisition via Higher-order Selectional Preference over Eventualities

1 code implementation5 Apr 2021 Hongming Zhang, Xin Liu, Haojie Pan, Haowen Ke, Jiefu Ou, Tianqing Fang, Yangqiu Song

After conceptualization with Probase, a selectional preference based concept-instance relational knowledge base, our concept graph contains 15 million conceptualized eventualities and 224 million edges between them.

Discourse Parsing

Streaming Social Event Detection and Evolution Discovery in Heterogeneous Information Networks

1 code implementation2 Apr 2021 Hao Peng, JianXin Li, Yangqiu Song, Renyu Yang, Rajiv Ranjan, Philip S. Yu, Lifang He

Third, we propose a streaming social event detection and evolution discovery framework for HINs based on meta-path similarity search, historical information about meta-paths, and heterogeneous DBSCAN clustering method.

Clustering Event Detection

Wasserstein Graph Neural Networks for Graphs with Missing Attributes

no code implementations6 Feb 2021 Zhixian Chen, Tengfei Ma, Yangqiu Song, Yang Wang

In this paper, we propose an innovative node representation learning framework, Wasserstein Graph Neural Network (WGNN), to mitigate the problem.

Attribute Graph Representation Learning +3

Joint Coreference Resolution and Character Linking for Multiparty Conversation

1 code implementation EACL 2021 Jiaxin Bai, Hongming Zhang, Yangqiu Song, Kun Xu

Character linking, the task of linking mentioned people in conversations to the real world, is crucial for understanding the conversations.

coreference-resolution Entity Linking

DISCOS: Bridging the Gap between Discourse Knowledge and Commonsense Knowledge

1 code implementation1 Jan 2021 Tianqing Fang, Hongming Zhang, Weiqi Wang, Yangqiu Song, Bin He

On the other hand, generation models have the potential to automatically generate more knowledge.

Text Generation

Learning Contextual Causality from Time-consecutive Images

1 code implementation13 Dec 2020 Hongming Zhang, Yintong Huo, Xinran Zhao, Yangqiu Song, Dan Roth

Compared with pure text-based approaches, learning causality from the visual signal has the following advantages: (1) Causality knowledge belongs to the commonsense knowledge, which is rarely expressed in the text but rich in videos; (2) Most events in the video are naturally time-ordered, which provides a rich resource for us to mine causality knowledge from; (3) All the objects in the video can be used as context to study the contextual property of causal relations.

Analogous Process Structure Induction for Sub-event Sequence Prediction

no code implementations EMNLP 2020 Hongming Zhang, Muhao Chen, Haoyu Wang, Yangqiu Song, Dan Roth

Computational and cognitive studies of event understanding suggest that identifying, comprehending, and predicting events depend on having structured representations of a sequence of events and on conceptualizing (abstracting) its components into (soft) event categories.

Two Sides of the Same Coin: White-box and Black-box Attacks for Transfer Learning

1 code implementation25 Aug 2020 Yinghua Zhang, Yangqiu Song, Jian Liang, Kun Bai, Qiang Yang

To systematically measure the effect of both white-box and black-box attacks, we propose a new metric to evaluate how transferable are the adversarial examples produced by a source model to a target model.

Transfer Learning

Peer-inspired Student Performance Prediction in Interactive Online Question Pools with Graph Neural Network

no code implementations4 Aug 2020 Haotian Li, Huan Wei, Yong Wang, Yangqiu Song, Huamin Qu

Specifically, we model the relationship between students and questions using student interactions to construct the student-interaction-question network and further present a new GNN model, called R^2GCN, which intrinsically works for the heterogeneous networks, to achieve generalizable student performance prediction in interactive online question pools.

Enriching Large-Scale Eventuality Knowledge Graph with Entailment Relations

1 code implementation AKBC 2020 Changlong Yu, Hongming Zhang, Yangqiu Song, Wilfred Ng, Lifeng Shang

Computational and cognitive studies suggest that the abstraction of eventualities (activities, states, and events) is crucial for humans to understand daily eventualities.


WinoWhy: A Deep Diagnosis of Essential Commonsense Knowledge for Answering Winograd Schema Challenge

1 code implementation ACL 2020 Hongming Zhang, Xinran Zhao, Yangqiu Song

Experimental results prove that even though pre-trained language representation models have achieved promising progress on the original WSC dataset, they are still struggling at WinoWhy.


SocialTrans: A Deep Sequential Model with Social Information for Web-Scale Recommendation Systems

no code implementations9 May 2020 Qiaoan Chen, Hao Gu, Lingling Yi, Yishi Lin, Peng He, Chuan Chen, Yangqiu Song

Experiments on three data sets verify the effectiveness of our model and show that it outperforms state-of-the-art social recommendation methods.

Graph Attention Recommendation Systems

TransOMCS: From Linguistic Graphs to Commonsense Knowledge

1 code implementation1 May 2020 Hongming Zhang, Daniel Khashabi, Yangqiu Song, Dan Roth

Commonsense knowledge acquisition is a key problem for artificial intelligence.

On the Importance of Word and Sentence Representation Learning in Implicit Discourse Relation Classification

1 code implementation27 Apr 2020 Xin Liu, Jiefu Ou, Yangqiu Song, Xin Jiang

Implicit discourse relation classification is one of the most difficult parts in shallow discourse parsing as the relation prediction without explicit connectives requires the language understanding at both the text span level and the sentence level.

Discourse Parsing General Classification +4

A Chinese Corpus for Fine-grained Entity Typing

1 code implementation LREC 2020 Chin Lee, Hongliang Dai, Yangqiu Song, Xin Li

In this paper, we introduce a corpus for Chinese fine-grained entity typing that contains 4, 800 mentions manually labeled through crowdsourcing.

Cross-Lingual Transfer Entity Typing +1

Fisher Deep Domain Adaptation

1 code implementation12 Mar 2020 Yinghua Zhang, Yu Zhang, Ying WEI, Kun Bai, Yangqiu Song, Qiang Yang

Though the learned representations are separable in the source domain, they usually have a large variance and samples with different class labels tend to overlap in the target domain, which yields suboptimal adaptation performance.

Domain Adaptation

On the Role of Conceptualization in Commonsense Knowledge Graph Construction

1 code implementation6 Mar 2020 Mutian He, Yangqiu Song, Kun Xu, Dong Yu

Commonsense knowledge graphs (CKGs) like Atomic and ASER are substantially different from conventional KGs as they consist of much larger number of nodes formed by loosely-structured text, which, though, enables them to handle highly diverse queries in natural language related to commonsense, leads to unique challenges for automatic KG construction methods.

graph construction Knowledge Graphs +1

Exploiting Semantic Relations for Fine-grained Entity Typing

1 code implementation AKBC 2020 Hongliang Dai, Yangqiu Song, Xin Li

We find that, in some cases, existing neural fine-grained entity typing models may ignore the semantic information in the context that is important for typing.

Entity Typing Relation +2

Multiplex Word Embeddings for Selectional Preference Acquisition

1 code implementation IJCNLP 2019 Hongming Zhang, Jiaxin Bai, Yan Song, Kun Xu, Changlong Yu, Yangqiu Song, Wilfred Ng, Dong Yu

Therefore, in this paper, we propose a multiplex word embedding model, which can be easily extended according to various relations among words.

Word Embeddings Word Similarity

Neural Subgraph Isomorphism Counting

1 code implementation25 Dec 2019 Xin Liu, Haojie Pan, Mutian He, Yangqiu Song, Xin Jiang, Lifeng Shang

In this paper, we study a new graph learning problem: learning to count subgraph isomorphisms.

Domain Adaptation Graph Learning +4

RWNE: A Scalable Random-Walk-Based Network Embedding Framework with Personalized Higher-Order Proximity Preserved

1 code implementation18 Nov 2019 JianXin Li, Cheng Ji, Hao Peng, Yu He, Yangqiu Song, Xinmiao Zhang, Fanzhang Peng

However, despite the success of current random-walk-based methods, most of them are usually not expressive enough to preserve the personalized higher-order proximity and lack a straightforward objective to theoretically articulate what and how network proximity is preserved.

Network Embedding

Improving Fine-grained Entity Typing with Entity Linking

1 code implementation IJCNLP 2019 Hongliang Dai, Donghong Du, Xin Li, Yangqiu Song

Fine-grained entity typing is a challenging problem since it usually involves a relatively large tag set and may require to understand the context of the entity mention.

Entity Linking Entity Typing +1

What You See is What You Get: Visual Pronoun Coreference Resolution in Dialogues

1 code implementation IJCNLP 2019 Xintong Yu, Hongming Zhang, Yangqiu Song, Yan Song, Chang-Shui Zhang

To tackle this challenge, in this paper, we formally define the task of visual-aware pronoun coreference resolution (PCR) and introduce VisPro, a large-scale dialogue PCR dataset, to investigate whether and how the visual information can help resolve pronouns in dialogues.

coreference-resolution Natural Language Understanding

Motif Enhanced Recommendation over Heterogeneous Information Network

1 code implementation26 Aug 2019 Huan Zhao, Yingqi Zhou, Yangqiu Song, Dik Lun Lee

In this paper, we propose to use motifs to capture higher-order relations among nodes of same type in a HIN and develop the motif-enhanced meta-path (MEMP) to combine motif-based higher-order relations with edge-based first-order relations.

Recommendation Systems

Hyper-Path-Based Representation Learning for Hyper-Networks

1 code implementation24 Aug 2019 Jie Huang, Xin Liu, Yangqiu Song

Then a carefully designed algorithm, Hyper-gram, utilizes these random walks to capture both pairwise relationships and tuplewise relationships in the whole hyper-networks.

Link Prediction Representation Learning

Knowledge-aware Pronoun Coreference Resolution

1 code implementation ACL 2019 Hongming Zhang, Yan Song, Yangqiu Song, Dong Yu

Resolving pronoun coreference requires knowledge support, especially for particular domains (e. g., medicine).

coreference-resolution Knowledge Graphs

Neural Aspect and Opinion Term Extraction with Mined Rules as Weak Supervision

1 code implementation ACL 2019 Hongliang Dai, Yangqiu Song

Lack of labeled training data is a major bottleneck for neural network based aspect and opinion term extraction on product reviews.

Dependency Parsing Term Extraction

Fine-grained Event Categorization with Heterogeneous Graph Convolutional Networks

1 code implementation9 Jun 2019 Hao Peng, Jian-Xin Li, Qiran Gong, Yangqiu Song, Yuanxing Ning, Kunfeng Lai, Philip S. Yu

In this paper, we design an event meta-schema to characterize the semantic relatedness of social events and build an event-based heterogeneous information network (HIN) integrating information from external knowledge base, and propose a novel Pair-wise Popularity Graph Convolutional Network (PP-GCN) based fine-grained social event categorization model.

Clustering Event Detection

Beyond Personalization: Social Content Recommendation for Creator Equality and Consumer Satisfaction

1 code implementation28 May 2019 Wenyi Xiao, Huan Zhao, Haojie Pan, Yangqiu Song, Vincent W. Zheng, Qiang Yang

An effective content recommendation in modern social media platforms should benefit both creators to bring genuine benefits to them and consumers to help them get really interesting content.

Incorporating Context and External Knowledge for Pronoun Coreference Resolution

1 code implementation NAACL 2019 Hongming Zhang, Yan Song, Yangqiu Song

Linking pronominal expressions to the correct references requires, in many cases, better analysis of the contextual information and external knowledge.


SP-10K: A Large-scale Evaluation Set for Selectional Preference Acquisition

1 code implementation ACL 2019 Hongming Zhang, Hantian Ding, Yangqiu Song

Selectional Preference (SP) is a commonly observed language phenomenon and proved to be useful in many natural language processing tasks.


Relation Discovery with Out-of-Relation Knowledge Base as Supervision

1 code implementation NAACL 2019 Yan Liang, Xin Liu, Jianwen Zhang, Yangqiu Song

In this paper, we study the problem of how to use out-of-relation knowledge bases to supervise the discovery of unseen relations, where out-of-relation means that relations to discover from the text corpus and those in knowledge bases are not overlapped.


KBQA: Learning Question Answering over QA Corpora and Knowledge Bases

no code implementations6 Mar 2019 Wanyun Cui, Yanghua Xiao, Haixun Wang, Yangqiu Song, Seung-won Hwang, Wei Wang

Based on these templates, our QA system KBQA effectively supports binary factoid questions, as well as complex questions which are composed of a series of binary factoid questions.

Question Answering

Entity Linking within a Social Media Platform: A Case Study on Yelp

1 code implementation EMNLP 2018 Hongliang Dai, Yangqiu Song, Liwei Qiu, Rijia Liu

In this paper, we study a new entity linking problem where both the entity mentions and the target entities are within a same social media platform.

Entity Linking Learning-To-Rank

Side Information Fusion for Recommender Systems over Heterogeneous Information Network

1 code implementation8 Jan 2018 Huan Zhao, Quanming Yao, Yangqiu Song, James Kwok, Dik Lun Lee

Collaborative filtering (CF) has been one of the most important and popular recommendation methods, which aims at predicting users' preferences (ratings) based on their past behaviors.

Collaborative Filtering Recommendation Systems

Understanding Hidden Memories of Recurrent Neural Networks

1 code implementation30 Oct 2017 Yao Ming, Shaozu Cao, Ruixiang Zhang, Zhen Li, Yuanzhe Chen, Yangqiu Song, Huamin Qu

We propose a technique to explain the function of individual hidden state units based on their expected response to input texts.

Clustering Sentence

Subjective Knowledge Acquisition and Enrichment Powered By Crowdsourcing

no code implementations16 May 2017 Rui Meng, Hao Xin, Lei Chen, Yangqiu Song

In our work, we propose a system, called crowdsourced subjective knowledge acquisition (CoSKA), for subjective knowledge acquisition powered by crowdsourcing and existing KBs.

Machine Learning with World Knowledge: The Position and Survey

no code implementations8 May 2017 Yangqiu Song, Dan Roth

In this paper, we will discuss how to use the existing general-purpose world knowledge to enhance machine learning processes, by enriching the features or reducing the labeling work.

BIG-bench Machine Learning Information Retrieval +3

Maximum-Likelihood Augmented Discrete Generative Adversarial Networks

no code implementations26 Feb 2017 Tong Che, Yan-ran Li, Ruixiang Zhang, R. Devon Hjelm, Wenjie Li, Yangqiu Song, Yoshua Bengio

Despite the successes in capturing continuous distributions, the application of generative adversarial networks (GANs) to discrete settings, like natural language tasks, is rather restricted.

Cross-lingual Dataless Classification for Languages with Small Wikipedia Presence

no code implementations13 Nov 2016 Yangqiu Song, Stephen Mayhew, Dan Roth

We use a word-level dictionary to convert documents in a SWL to a large-Wikipedia language (LWLs), and then perform CLDDC based on the LWL's Wikipedia.

Classification Document Classification +4