1 code implementation • 14 Jan 2024 • Weiqi Wang, Tianqing Fang, Chunyang Li, Haochen Shi, Wenxuan Ding, Baixuan Xu, Zhaowei Wang, Jiaxin Bai, Xin Liu, Jiayang Cheng, Chunkit Chan, Yangqiu Song
The sequential process of conceptualization and instantiation is essential to generalizable commonsense reasoning as it allows the application of existing knowledge to unfamiliar scenarios.
3 code implementations • 9 Jun 2022 • Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang, Alicia Parrish, Allen Nie, Aman Hussain, Amanda Askell, Amanda Dsouza, Ambrose Slone, Ameet Rahane, Anantharaman S. Iyer, Anders Andreassen, Andrea Madotto, Andrea Santilli, Andreas Stuhlmüller, Andrew Dai, Andrew La, Andrew Lampinen, Andy Zou, Angela Jiang, Angelica Chen, Anh Vuong, Animesh Gupta, Anna Gottardi, Antonio Norelli, Anu Venkatesh, Arash Gholamidavoodi, Arfa Tabassum, Arul Menezes, Arun Kirubarajan, Asher Mullokandov, Ashish Sabharwal, Austin Herrick, Avia Efrat, Aykut Erdem, Ayla Karakaş, B. Ryan Roberts, Bao Sheng Loe, Barret Zoph, Bartłomiej Bojanowski, Batuhan Özyurt, Behnam Hedayatnia, Behnam Neyshabur, Benjamin Inden, Benno Stein, Berk Ekmekci, Bill Yuchen Lin, Blake Howald, Bryan Orinion, Cameron Diao, Cameron Dour, Catherine Stinson, Cedrick Argueta, César Ferri Ramírez, Chandan Singh, Charles Rathkopf, Chenlin Meng, Chitta Baral, Chiyu Wu, Chris Callison-Burch, Chris Waites, Christian Voigt, Christopher D. Manning, Christopher Potts, Cindy Ramirez, Clara E. Rivera, Clemencia Siro, Colin Raffel, Courtney Ashcraft, Cristina Garbacea, Damien Sileo, Dan Garrette, Dan Hendrycks, Dan Kilman, Dan Roth, Daniel Freeman, Daniel Khashabi, Daniel Levy, Daniel Moseguí González, Danielle Perszyk, Danny Hernandez, Danqi Chen, Daphne Ippolito, Dar Gilboa, David Dohan, David Drakard, David Jurgens, Debajyoti Datta, Deep Ganguli, Denis Emelin, Denis Kleyko, Deniz Yuret, Derek Chen, Derek Tam, Dieuwke Hupkes, Diganta Misra, Dilyar Buzan, Dimitri Coelho Mollo, Diyi Yang, Dong-Ho Lee, Dylan Schrader, Ekaterina Shutova, Ekin Dogus Cubuk, Elad Segal, Eleanor Hagerman, Elizabeth Barnes, Elizabeth Donoway, Ellie Pavlick, Emanuele Rodola, Emma Lam, Eric Chu, Eric Tang, Erkut Erdem, Ernie Chang, Ethan A. Chi, Ethan Dyer, Ethan Jerzak, Ethan Kim, Eunice Engefu Manyasi, Evgenii Zheltonozhskii, Fanyue Xia, Fatemeh Siar, Fernando Martínez-Plumed, Francesca Happé, Francois Chollet, Frieda Rong, Gaurav Mishra, Genta Indra Winata, Gerard de Melo, Germán Kruszewski, Giambattista Parascandolo, Giorgio Mariani, Gloria Wang, Gonzalo Jaimovitch-López, Gregor Betz, Guy Gur-Ari, Hana Galijasevic, Hannah Kim, Hannah Rashkin, Hannaneh Hajishirzi, Harsh Mehta, Hayden Bogar, Henry Shevlin, Hinrich Schütze, Hiromu Yakura, Hongming Zhang, Hugh Mee Wong, Ian Ng, Isaac Noble, Jaap Jumelet, Jack Geissinger, Jackson Kernion, Jacob Hilton, Jaehoon Lee, Jaime Fernández Fisac, James B. Simon, James Koppel, James Zheng, James Zou, Jan Kocoń, Jana Thompson, Janelle Wingfield, Jared Kaplan, Jarema Radom, Jascha Sohl-Dickstein, Jason Phang, Jason Wei, Jason Yosinski, Jekaterina Novikova, Jelle Bosscher, Jennifer Marsh, Jeremy Kim, Jeroen Taal, Jesse Engel, Jesujoba Alabi, Jiacheng Xu, Jiaming Song, Jillian Tang, Joan Waweru, John Burden, John Miller, John U. Balis, Jonathan Batchelder, Jonathan Berant, Jörg Frohberg, Jos Rozen, Jose Hernandez-Orallo, Joseph Boudeman, Joseph Guerr, Joseph Jones, Joshua B. Tenenbaum, Joshua S. Rule, Joyce Chua, Kamil Kanclerz, Karen Livescu, Karl Krauth, Karthik Gopalakrishnan, Katerina Ignatyeva, Katja Markert, Kaustubh D. Dhole, Kevin Gimpel, Kevin Omondi, Kory Mathewson, Kristen Chiafullo, Ksenia Shkaruta, Kumar Shridhar, Kyle McDonell, Kyle Richardson, Laria Reynolds, Leo Gao, Li Zhang, Liam Dugan, Lianhui Qin, Lidia Contreras-Ochando, Louis-Philippe Morency, Luca Moschella, Lucas Lam, Lucy Noble, Ludwig Schmidt, Luheng He, Luis Oliveros Colón, Luke Metz, Lütfi Kerem Şenel, Maarten Bosma, Maarten Sap, Maartje ter Hoeve, Maheen Farooqi, Manaal Faruqui, Mantas Mazeika, Marco Baturan, Marco Marelli, Marco Maru, Maria Jose Ramírez Quintana, Marie Tolkiehn, Mario Giulianelli, Martha Lewis, Martin Potthast, Matthew L. Leavitt, Matthias Hagen, Mátyás Schubert, Medina Orduna Baitemirova, Melody Arnaud, Melvin McElrath, Michael A. Yee, Michael Cohen, Michael Gu, Michael Ivanitskiy, Michael Starritt, Michael Strube, Michał Swędrowski, Michele Bevilacqua, Michihiro Yasunaga, Mihir Kale, Mike Cain, Mimee Xu, Mirac Suzgun, Mitch Walker, Mo Tiwari, Mohit Bansal, Moin Aminnaseri, Mor Geva, Mozhdeh Gheini, Mukund Varma T, Nanyun Peng, Nathan A. Chi, Nayeon Lee, Neta Gur-Ari Krakover, Nicholas Cameron, Nicholas Roberts, Nick Doiron, Nicole Martinez, Nikita Nangia, Niklas Deckers, Niklas Muennighoff, Nitish Shirish Keskar, Niveditha S. Iyer, Noah Constant, Noah Fiedel, Nuan Wen, Oliver Zhang, Omar Agha, Omar Elbaghdadi, Omer Levy, Owain Evans, Pablo Antonio Moreno Casares, Parth Doshi, Pascale Fung, Paul Pu Liang, Paul Vicol, Pegah Alipoormolabashi, Peiyuan Liao, Percy Liang, Peter Chang, Peter Eckersley, Phu Mon Htut, Pinyu Hwang, Piotr Miłkowski, Piyush Patil, Pouya Pezeshkpour, Priti Oli, Qiaozhu Mei, Qing Lyu, Qinlang Chen, Rabin Banjade, Rachel Etta Rudolph, Raefer Gabriel, Rahel Habacker, Ramon Risco, Raphaël Millière, Rhythm Garg, Richard Barnes, Rif A. Saurous, Riku Arakawa, Robbe Raymaekers, Robert Frank, Rohan Sikand, Roman Novak, Roman Sitelew, Ronan LeBras, Rosanne Liu, Rowan Jacobs, Rui Zhang, Ruslan Salakhutdinov, Ryan Chi, Ryan Lee, Ryan Stovall, Ryan Teehan, Rylan Yang, Sahib Singh, Saif M. Mohammad, Sajant Anand, Sam Dillavou, Sam Shleifer, Sam Wiseman, Samuel Gruetter, Samuel R. Bowman, Samuel S. Schoenholz, Sanghyun Han, Sanjeev Kwatra, Sarah A. Rous, Sarik Ghazarian, Sayan Ghosh, Sean Casey, Sebastian Bischoff, Sebastian Gehrmann, Sebastian Schuster, Sepideh Sadeghi, Shadi Hamdan, Sharon Zhou, Shashank Srivastava, Sherry Shi, Shikhar Singh, Shima Asaadi, Shixiang Shane Gu, Shubh Pachchigar, Shubham Toshniwal, Shyam Upadhyay, Shyamolima, Debnath, Siamak Shakeri, Simon Thormeyer, Simone Melzi, Siva Reddy, Sneha Priscilla Makini, Soo-Hwan Lee, Spencer Torene, Sriharsha Hatwar, Stanislas Dehaene, Stefan Divic, Stefano Ermon, Stella Biderman, Stephanie Lin, Stephen Prasad, Steven T. Piantadosi, Stuart M. Shieber, Summer Misherghi, Svetlana Kiritchenko, Swaroop Mishra, Tal Linzen, Tal Schuster, Tao Li, Tao Yu, Tariq Ali, Tatsu Hashimoto, Te-Lin Wu, Théo Desbordes, Theodore Rothschild, Thomas Phan, Tianle Wang, Tiberius Nkinyili, Timo Schick, Timofei Kornev, Titus Tunduny, Tobias Gerstenberg, Trenton Chang, Trishala Neeraj, Tushar Khot, Tyler Shultz, Uri Shaham, Vedant Misra, Vera Demberg, Victoria Nyamai, Vikas Raunak, Vinay Ramasesh, Vinay Uday Prabhu, Vishakh Padmakumar, Vivek Srikumar, William Fedus, William Saunders, William Zhang, Wout Vossen, Xiang Ren, Xiaoyu Tong, Xinran Zhao, Xinyi Wu, Xudong Shen, Yadollah Yaghoobzadeh, Yair Lakretz, Yangqiu Song, Yasaman Bahri, Yejin Choi, Yichi Yang, Yiding Hao, Yifu Chen, Yonatan Belinkov, Yu Hou, Yufang Hou, Yuntao Bai, Zachary Seid, Zhuoye Zhao, Zijian Wang, Zijie J. Wang, ZiRui Wang, Ziyi Wu
BIG-bench focuses on tasks that are believed to be beyond the capabilities of current language models.
1 code implementation • LREC 2018 • Daniel Khashabi, Mark Sammons, Ben Zhou, Tom Redman, Christos Christodoulopoulos, Vivek Srikumar, Nicholas Rizzolo, Lev Ratinov, Guanheng Luo, Quang Do, Chen-Tse Tsai, Subhro Roy, Stephen Mayhew, Zhili Feng, John Wieting, Xiaodong Yu, Yangqiu Song, Shashank Gupta, Shyam Upadhyay, Naveen Arivazhagan, Qiang Ning, Shaoshi Ling, Dan Roth
2 code implementations • 1 May 2019 • Hongming Zhang, Xin Liu, Haojie Pan, Yangqiu Song, Cane Wing-Ki Leung
Understanding human's language requires complex world knowledge.
1 code implementation • 5 Apr 2021 • Hongming Zhang, Xin Liu, Haojie Pan, Haowen Ke, Jiefu Ou, Tianqing Fang, Yangqiu Song
After conceptualization with Probase, a selectional preference based concept-instance relational knowledge base, our concept graph contains 15 million conceptualized eventualities and 224 million edges between them.
1 code implementation • 30 Oct 2017 • Yao Ming, Shaozu Cao, Ruixiang Zhang, Zhen Li, Yuanzhe Chen, Yangqiu Song, Huamin Qu
We propose a technique to explain the function of individual hidden state units based on their expected response to input texts.
1 code implementation • 8 Jan 2018 • Huan Zhao, Quanming Yao, Yangqiu Song, James Kwok, Dik Lun Lee
Collaborative filtering (CF) has been one of the most important and popular recommendation methods, which aims at predicting users' preferences (ratings) based on their past behaviors.
1 code implementation • 1 May 2020 • Hongming Zhang, Daniel Khashabi, Yangqiu Song, Dan Roth
Commonsense knowledge acquisition is a key problem for artificial intelligence.
1 code implementation • IJCNLP 2019 • Nedjma Ousidhoum, Zizheng Lin, Hongming Zhang, Yangqiu Song, Dit-yan Yeung
Current research on hate speech analysis is typically oriented towards monolingual and single classification tasks.
1 code implementation • 28 Oct 2022 • Haojie Pan, Zepeng Zhai, Yuzhou Zhang, Ruiji Fu, Ming Liu, Yangqiu Song, Zhongyuan Wang, Bing Qin
In this paper, we propose Kuaipedia, a large-scale multi-modal encyclopedia consisting of items, aspects, and short videos lined to them, which was extracted from billions of videos of Kuaishou (Kwai), a well-known short-video platform in China.
1 code implementation • 25 Dec 2019 • Xin Liu, Haojie Pan, Mutian He, Yangqiu Song, Xin Jiang, Lifeng Shang
In this paper, we study a new graph learning problem: learning to count subgraph isomorphisms.
1 code implementation • 1 Jan 2021 • Tianqing Fang, Hongming Zhang, Weiqi Wang, Yangqiu Song, Bin He
On the other hand, generation models have the potential to automatically generate more knowledge.
2 code implementations • EMNLP 2021 • Tianqing Fang, Weiqi Wang, Sehyun Choi, Shibo Hao, Hongming Zhang, Yangqiu Song, Bin He
Experimental results show that generalizing commonsense reasoning on unseen assertions is inherently a hard task.
1 code implementation • ACL 2019 • Hongliang Dai, Yangqiu Song
Lack of labeled training data is a major bottleneck for neural network based aspect and opinion term extraction on product reviews.
1 code implementation • 31 Oct 2023 • Nuo Chen, Zinan Zheng, Ning Wu, Ming Gong, Yangqiu Song, Dongmei Zhang, Jia Li
This indicates that crafting multilingual corpora can be regarded as a vital strategy for enhancing model performance in a specific language, especially in mathematical reasoning tasks.
1 code implementation • 4 May 2023 • Haoran Li, Mingshi Xu, Yangqiu Song
In this work, we further investigate the information leakage issue and propose a generative embedding inversion attack (GEIA) that aims to reconstruct input sequences based only on their sentence embeddings.
1 code implementation • 17 May 2021 • Hao Peng, Haoran Li, Yangqiu Song, Vincent Zheng, JianXin Li
However, for multiple cross-domain knowledge graphs, state-of-the-art embedding models cannot make full use of the data from different knowledge domains while preserving the privacy of exchanged data.
1 code implementation • IJCNLP 2019 • Xintong Yu, Hongming Zhang, Yangqiu Song, Yan Song, Chang-Shui Zhang
To tackle this challenge, in this paper, we formally define the task of visual-aware pronoun coreference resolution (PCR) and introduce VisPro, a large-scale dialogue PCR dataset, to investigate whether and how the visual information can help resolve pronouns in dialogues.
1 code implementation • 20 Apr 2023 • Tianqing Fang, Quyet V. Do, Sehyun Choi, Weiqi Wang, Yangqiu Song
Populating Commonsense Knowledge Bases (CSKB) is an important yet hard task in NLP, as it tackles knowledge from external sources with unseen events and entities.
1 code implementation • 9 Jun 2019 • Hao Peng, Jian-Xin Li, Qiran Gong, Yangqiu Song, Yuanxing Ning, Kunfeng Lai, Philip S. Yu
In this paper, we design an event meta-schema to characterize the semantic relatedness of social events and build an event-based heterogeneous information network (HIN) integrating information from external knowledge base, and propose a novel Pair-wise Popularity Graph Convolutional Network (PP-GCN) based fine-grained social event categorization model.
1 code implementation • 3 Jun 2022 • Mutian He, Tianqing Fang, Weiqi Wang, Yangqiu Song
Conceptualization, or viewing entities and situations as instances of abstract concepts in mind and making inferences based on that, is a vital component in human intelligence for commonsense reasoning.
1 code implementation • 13 Oct 2023 • Sehyun Choi, Tianqing Fang, Zhaowei Wang, Yangqiu Song
Large Language Models (LLMs) have demonstrated remarkable human-level natural language generation capabilities.
1 code implementation • 16 Dec 2021 • Xin Liu, Yangqiu Song
Based on this observation, we propose dual message passing neural networks (DMPNNs) to enhance the substructure representation learning in an asynchronous way for subgraph isomorphism counting and matching as well as unsupervised node classification.
1 code implementation • 9 May 2023 • Zhaowei Wang, Quyet V. Do, Hongming Zhang, Jiayao Zhang, Weiqi Wang, Tianqing Fang, Yangqiu Song, Ginny Y. Wong, Simon See
This paper proposes a new task to detect commonsense causation between two events in an event sequence (i. e., context), called contextualized commonsense causal reasoning.
1 code implementation • NAACL 2019 • Ziqian Zeng, Wenxuan Zhou, Xin Liu, Yangqiu Song
These word pairs can be extracted by using dependency parsers and simple rules.
1 code implementation • 15 Nov 2022 • Changlong Yu, Weiqi Wang, Xin Liu, Jiaxin Bai, Yangqiu Song, Zheng Li, Yifan Gao, Tianyu Cao, Bing Yin
Understanding users' intentions in e-commerce platforms requires commonsense knowledge.
1 code implementation • 27 Apr 2020 • Xin Liu, Jiefu Ou, Yangqiu Song, Xin Jiang
Implicit discourse relation classification is one of the most difficult parts in shallow discourse parsing as the relation prediction without explicit connectives requires the language understanding at both the text span level and the sentence level.
2 code implementations • 18 Sep 2021 • ZiHao Wang, Hang Yin, Yangqiu Song
Besides, our work, for the first time, provides a benchmark to evaluate and analyze the impact of different operators and normal forms by using (a) 7 choices of the operator systems and (b) 9 forms of complex queries.
1 code implementation • ACL 2021 • Hongliang Dai, Yangqiu Song, Haixun Wang
Recently, there is an effort to extend fine-grained entity typing by using a richer and ultra-fine set of types, and labeling noun phrases including pronouns and nominal nouns instead of just named entity mentions.
Ranked #1 on Entity Typing on Ontonotes v5 (English) (using extra training data)
1 code implementation • 17 Jun 2022 • Xin Liu, Jiayang Cheng, Yangqiu Song, Xin Jiang
We extend graph kernels and graph neural networks with dummy nodes and conduct experiments on graph classification and subgraph isomorphism matching tasks.
1 code implementation • ACL 2020 • Hongming Zhang, Xinran Zhao, Yangqiu Song
Experimental results prove that even though pre-trained language representation models have achieved promising progress on the original WSC dataset, they are still struggling at WinoWhy.
1 code implementation • ACL 2019 • Hongming Zhang, Yan Song, Yangqiu Song, Dong Yu
Resolving pronoun coreference requires knowledge support, especially for particular domains (e. g., medicine).
1 code implementation • IJCNLP 2019 • Hongliang Dai, Donghong Du, Xin Li, Yangqiu Song
Fine-grained entity typing is a challenging problem since it usually involves a relatively large tag set and may require to understand the context of the entity mention.
1 code implementation • LREC 2020 • Chin Lee, Hongliang Dai, Yangqiu Song, Xin Li
In this paper, we introduce a corpus for Chinese fine-grained entity typing that contains 4, 800 mentions manually labeled through crowdsourcing.
1 code implementation • NAACL 2019 • Hongming Zhang, Yan Song, Yangqiu Song
Linking pronominal expressions to the correct references requires, in many cases, better analysis of the contextual information and external knowledge.
1 code implementation • 28 May 2019 • Wenyi Xiao, Huan Zhao, Haojie Pan, Yangqiu Song, Vincent W. Zheng, Qiang Yang
An effective content recommendation in modern social media platforms should benefit both creators to bring genuine benefits to them and consumers to help them get really interesting content.
1 code implementation • 26 Aug 2019 • Huan Zhao, Yingqi Zhou, Yangqiu Song, Dik Lun Lee
In this paper, we propose to use motifs to capture higher-order relations among nodes of same type in a HIN and develop the motif-enhanced meta-path (MEMP) to combine motif-based higher-order relations with edge-based first-order relations.
1 code implementation • 6 Mar 2020 • Mutian He, Yangqiu Song, Kun Xu, Dong Yu
Commonsense knowledge graphs (CKGs) like Atomic and ASER are substantially different from conventional KGs as they consist of much larger number of nodes formed by loosely-structured text, which, though, enables them to handle highly diverse queries in natural language related to commonsense, leads to unique challenges for automatic KG construction methods.
1 code implementation • 25 Feb 2019 • Huiru Xiao, Xin Liu, Yangqiu Song
Hierarchical text classification has many real-world applications.
1 code implementation • 21 Jan 2023 • ZiHao Wang, Yangqiu Song, Ginny Y. Wong, Simon See
On top of the query graph, we propose the Logical Message Passing Neural Network (LMPNN) that connects the local one-hop inferences on atomic formulas to the global logical reasoning for complex query answering.
1 code implementation • 2 Jun 2023 • Jiaxin Bai, Chen Luo, Zheng Li, Qingyu Yin, Bing Yin, Yangqiu Song
To address the difference between entities and numerical values, we also propose the framework of Number Reasoning Network (NRN) for alternatively encoding entities and numerical values into separate encoding structures.
1 code implementation • 15 Nov 2023 • Zhaowei Wang, Haochen Shi, Weiqi Wang, Tianqing Fang, Hongming Zhang, Sehyun Choi, Xin Liu, Yangqiu Song
Cognitive research indicates that abstraction ability is essential in human intelligence, which remains under-explored in language models.
1 code implementation • EMNLP 2018 • Hongliang Dai, Yangqiu Song, Liwei Qiu, Rijia Liu
In this paper, we study a new entity linking problem where both the entity mentions and the target entities are within a same social media platform.
1 code implementation • 13 Oct 2022 • Zhaowei Wang, Hongming Zhang, Tianqing Fang, Yangqiu Song, Ginny Y. Wong, Simon See
In this paper, we propose a new task of sub-event generation for an unseen process to evaluate the understanding of the coherence of sub-event actions and objects.
1 code implementation • 14 Oct 2022 • Tianqing Fang, Quyet V. Do, Hongming Zhang, Yangqiu Song, Ginny Y. Wong, Simon See
We propose PseudoReasoner, a semi-supervised learning framework for CSKB population that uses a teacher model pre-trained on CSKBs to provide pseudo labels on the unlabeled candidate dataset for a student model to learn from.
1 code implementation • 7 Nov 2022 • Huiru Xiao, Xin Liu, Yangqiu Song, Ginny Y. Wong, Simon See
However, the performance of the hyperbolic KG embedding models for non-transitive relations is still unpromising, while the complex hyperbolic embeddings do not deal with multi-relations.
1 code implementation • 6 May 2023 • ZiHao Wang, Weizhi Fei, Hang Yin, Yangqiu Song, Ginny Y. Wong, Simon See
In contrast to existing scoring functions motivated by local comparison or global transport, this work investigates the local and global trade-off with unbalanced optimal transport theory.
1 code implementation • ACL 2019 • Hongming Zhang, Hantian Ding, Yangqiu Song
Selectional Preference (SP) is a commonly observed language phenomenon and proved to be useful in many natural language processing tasks.
1 code implementation • EMNLP 2020 • Changlong Yu, Jialong Han, Peifeng Wang, Yangqiu Song, Hongming Zhang, Wilfred Ng, Shuming Shi
We also demonstrate that distributional methods are ideal to make up for pattern-based ones in such cases.
1 code implementation • Findings (NAACL) 2022 • Ziqian Zeng, Weimin Ni, Tianqing Fang, Xiang Li, Xinran Zhao, Yangqiu Song
In this paper, we propose to query a masked language model with cloze style prompts to obtain supervision signals.
1 code implementation • 14 Oct 2022 • Ying Su, ZiHao Wang, Tianqing Fang, Hongming Zhang, Yangqiu Song, Tong Zhang
Commonsense reasoning tasks such as commonsense knowledge graph completion and commonsense question answering require powerful representation learning.
1 code implementation • 11 Apr 2023 • Haoran Li, Dadi Guo, Wei Fan, Mingshi Xu, Jie Huang, Fanpu Meng, Yangqiu Song
With the rapid progress of large language models (LLMs), many downstream NLP tasks can be well solved given appropriate prompts.
2 code implementations • 8 May 2023 • Weiqi Wang, Tianqing Fang, Baixuan Xu, Chun Yi Louis Bo, Yangqiu Song, Lei Chen
Commonsense reasoning, aiming at endowing machines with a human-like ability to make situational presumptions, is extremely challenging to generalize.
1 code implementation • EACL 2021 • Jiaxin Bai, Hongming Zhang, Yangqiu Song, Kun Xu
Character linking, the task of linking mentioned people in conversations to the real world, is crucial for understanding the conversations.
1 code implementation • Findings (NAACL) 2022 • Jiaxin Bai, ZiHao Wang, Hongming Zhang, Yangqiu Song
The query embedding method is proposed to answer these queries by jointly encoding queries and entities to the same embedding space.
1 code implementation • NAACL 2019 • Yan Liang, Xin Liu, Jianwen Zhang, Yangqiu Song
In this paper, we study the problem of how to use out-of-relation knowledge bases to supervise the discovery of unseen relations, where out-of-relation means that relations to discover from the text corpus and those in knowledge bases are not overlapped.
1 code implementation • 12 Mar 2020 • Yinghua Zhang, Yu Zhang, Ying WEI, Kun Bai, Yangqiu Song, Qiang Yang
Though the learned representations are separable in the source domain, they usually have a large variance and samples with different class labels tend to overlap in the target domain, which yields suboptimal adaptation performance.
1 code implementation • AKBC 2020 • Changlong Yu, Hongming Zhang, Yangqiu Song, Wilfred Ng, Lifeng Shang
Computational and cognitive studies suggest that the abstraction of eventualities (activities, states, and events) is crucial for humans to understand daily eventualities.
1 code implementation • 26 Apr 2022 • Haoran Li, Yangqiu Song, Lixin Fan
To this end, we propose effective defense objectives to protect persona leakage from hidden states.
1 code implementation • 29 May 2022 • Xintong Yu, Hongming Zhang, Ruixin Hong, Yangqiu Song, ChangShui Zhang
In this paper, we propose VD-PCR, a novel framework to improve Visual Dialog understanding with Pronoun Coreference Resolution in both implicit and explicit ways.
1 code implementation • NAACL 2022 • Haoran Li, Yangqiu Song, Lixin Fan
To this end, we propose effective defense objectives to protect persona leakage from hidden states.
1 code implementation • 6 May 2023 • Chunkit Chan, Xin Liu, Jiayang Cheng, Zihan Li, Yangqiu Song, Ginny Y. Wong, Simon See
Implicit Discourse Relation Recognition (IDRR) is a sophisticated and challenging task to recognize the discourse relations between the arguments with the absence of discourse connectives.
1 code implementation • NeurIPS 2023 • Jiaxin Bai, Xin Liu, Weiqi Wang, Chen Luo, Yangqiu Song
Traditional neural complex query answering (CQA) approaches mostly work on entity-centric KGs.
1 code implementation • 25 Feb 2023 • Jiaxin Bai, Tianshi Zheng, Yangqiu Song
Instead of parameterizing and executing the computational graph, SQE first uses a search-based algorithm to linearize the computational graph to a sequence of tokens and then uses a sequence encoder to compute its vector representation.
1 code implementation • 24 May 2023 • Weiqi Wang, Tianqing Fang, Wenxuan Ding, Baixuan Xu, Xin Liu, Yangqiu Song, Antoine Bosselut
The task of zero-shot commonsense question answering evaluates models on their capacity to reason about general scenarios beyond those presented in specific datasets.
1 code implementation • 15 Jul 2023 • Hang Yin, ZiHao Wang, Weizhi Fei, Yangqiu Song
Learning-based methods are essential because they are capable of generalizing over unobserved knowledge.
1 code implementation • 13 Dec 2020 • Hongming Zhang, Yintong Huo, Xinran Zhao, Yangqiu Song, Dan Roth
Compared with pure text-based approaches, learning causality from the visual signal has the following advantages: (1) Causality knowledge belongs to the commonsense knowledge, which is rarely expressed in the text but rich in videos; (2) Most events in the video are naturally time-ordered, which provides a rich resource for us to mine causality knowledge from; (3) All the objects in the video can be used as context to study the contextual property of causal relations.
1 code implementation • 17 Oct 2023 • Haochen Shi, Weiqi Wang, Tianqing Fang, Baixuan Xu, Wenxuan Ding, Xin Liu, Yangqiu Song
Zero-shot commonsense Question-Answering (QA) requires models to reason about general situations beyond specific benchmarks.
1 code implementation • 19 Oct 2023 • Cheng Jiayang, Lin Qiu, Tsz Ho Chan, Tianqing Fang, Weiqi Wang, Chunkit Chan, Dongyu Ru, Qipeng Guo, Hongming Zhang, Yangqiu Song, Yue Zhang, Zheng Zhang
Analogy-making between narratives is crucial for human reasoning.
1 code implementation • 24 Aug 2019 • Jie Huang, Xin Liu, Yangqiu Song
Then a carefully designed algorithm, Hyper-gram, utilizes these random walks to capture both pairwise relationships and tuplewise relationships in the whole hyper-networks.
1 code implementation • 27 Sep 2020 • Hongming Zhang, Xinran Zhao, Yangqiu Song
Pronoun Coreference Resolution (PCR) is the task of resolving pronominal expressions to all mentions they refer to.
1 code implementation • 2 Apr 2021 • Hao Peng, JianXin Li, Yangqiu Song, Renyu Yang, Rajiv Ranjan, Philip S. Yu, Lifang He
Third, we propose a streaming social event detection and evolution discovery framework for HINs based on meta-path similarity search, historical information about meta-paths, and heterogeneous DBSCAN clustering method.
1 code implementation • 18 Apr 2021 • Ziqian Zeng, Rashidul Islam, Kamrun Naher Keya, James Foulds, Yangqiu Song, SHimei Pan
Recently, much attention has been paid to the societal impact of AI, especially concerns regarding its fairness.
1 code implementation • NeurIPS 2021 • Huiru Xiao, Caigao Jiang, Yangqiu Song, James Zhang, Junwu Xiong
Specifically, we propose to learn the embeddings of hierarchically structured data in the unit ball model of the complex hyperbolic space.
1 code implementation • 14 Apr 2023 • Hang Yin, ZiHao Wang, Yangqiu Song
Moreover, we develop a new dataset containing ten new types of queries with features that have never been considered and therefore can provide a thorough investigation of complex queries.
1 code implementation • 15 Sep 2023 • Chunkit Chan, Xin Liu, Tsz Ho Chan, Jiayang Cheng, Yangqiu Song, Ginny Wong, Simon See
However, the inter-sentential coherence and the model consistency have not been well exploited in the previous works on this task.
1 code implementation • 8 Oct 2023 • Qing Zong, Zhaowei Wang, Baixuan Xu, Tianshi Zheng, Haochen Shi, Weiqi Wang, Yangqiu Song, Ginny Y. Wong, Simon See
A main goal of Argument Mining (AM) is to analyze an author's stance.
1 code implementation • 18 Oct 2023 • Zheye Deng, Weiqi Wang, Zhaowei Wang, Xin Liu, Yangqiu Song
Commonsense Knowledge Graphs (CSKGs) are crucial for commonsense reasoning, yet constructing them through human annotations can be costly.
1 code implementation • 25 Jan 2024 • Quyet V. Do, Tianqing Fang, Shizhe Diao, Zhaowei Wang, Yangqiu Song
When considering a new knowledge instance, ConstraintChecker employs a rule-based module to produce a list of constraints, then it uses a zero-shot learning module to check whether this knowledge instance satisfies all constraints.
1 code implementation • ACL 2021 • Xin Liu, Jiefu Ou, Yangqiu Song, Xin Jiang
Discourse relations among arguments reveal logical structures of a debate conversation.
1 code implementation • ACL 2021 • Nedjma Ousidhoum, Xinran Zhao, Tianqing Fang, Yangqiu Song, Dit-yan Yeung
Large pre-trained language models (PTLMs) have been shown to carry biases towards different social groups which leads to the reproduction of stereotypical and toxic content by major NLP systems.
1 code implementation • EMNLP 2021 • Xintong Yu, Hongming Zhang, Yangqiu Song, ChangShui Zhang, Kun Xu, Dong Yu
Resolving pronouns to their referents has long been studied as a fundamental natural language understanding problem.
1 code implementation • 5 Nov 2022 • Xiaojun Yang, Haoyu Zhong, Penglin Du, Keyi Zhou, Xingjin Lai, Zhengdong Wang, Yik Lun Lau, Yangqiu Song, Liyaning Tang
In this paper, more than 80, 000 paper abstracts in the built environment field were obtained to build a knowledge graph, a knowledge base storing entities and their connective relations in a graph-structured data model.
1 code implementation • IJCNLP 2019 • Hongming Zhang, Jiaxin Bai, Yan Song, Kun Xu, Changlong Yu, Yangqiu Song, Wilfred Ng, Dong Yu
Therefore, in this paper, we propose a multiplex word embedding model, which can be easily extended according to various relations among words.
1 code implementation • EMNLP 2020 • Nedjma Ousidhoum, Yangqiu Song, Dit-yan Yeung
Work on bias in hate speech typically aims to improve classification performance while relatively overlooking the quality of the data.
1 code implementation • ACL 2022 • Ying Su, Hongming Zhang, Yangqiu Song, Tong Zhang
However, the imbalanced training dataset leads to poor performance on rare senses and zero-shot senses.
1 code implementation • NeurIPS 2023 • Xin Liu, Zheng Li, Yifan Gao, Jingfeng Yang, Tianyu Cao, Zhengyang Wang, Bing Yin, Yangqiu Song
The goal of session-based recommendation in E-commerce is to predict the next item that an anonymous user will purchase based on the browsing and purchase history.
1 code implementation • 18 Nov 2019 • JianXin Li, Cheng Ji, Hao Peng, Yu He, Yangqiu Song, Xinmiao Zhang, Fanzhang Peng
However, despite the success of current random-walk-based methods, most of them are usually not expressive enough to preserve the personalized higher-order proximity and lack a straightforward objective to theoretically articulate what and how network proximity is preserved.
1 code implementation • AKBC 2021 • Huiru Xiao, Yangqiu Song
Nevertheless, transitivity is a special property that cannot be modeled efficiently in the Euclidean space.
1 code implementation • AKBC 2021 • Tianqing Fang, Haojie Pan, Hongming Zhang, Yangqiu Song, Kun Xu, Dong Yu
To evaluate the inference capability of different methods, we also propose a new evaluation metric based on CODC.
1 code implementation • 27 Oct 2023 • Wei Fan, Weijia Zhang, Weiqi Wang, Yangqiu Song, Hao liu
Conversational Recommender Systems (CRS) illuminate user preferences via multi-round interactive dialogues, ultimately navigating towards precise and satisfactory recommendations.
1 code implementation • 16 Feb 2024 • Zhaowei Wang, Wei Fan, Qing Zong, Hongming Zhang, Sehyun Choi, Tianqing Fang, Xin Liu, Yangqiu Song, Ginny Y. Wong, Simon See
Abstraction ability is crucial in human intelligence, which can also benefit various tasks in NLP study.
1 code implementation • 25 Aug 2020 • Yinghua Zhang, Yangqiu Song, Jian Liang, Kun Bai, Qiang Yang
To systematically measure the effect of both white-box and black-box attacks, we propose a new metric to evaluate how transferable are the adversarial examples produced by a source model to a target model.
1 code implementation • Findings (ACL) 2022 • Changlong Yu, Hongming Zhang, Yangqiu Song, Wilfred Ng
Large-scale pre-trained language models have demonstrated strong knowledge representation ability.
1 code implementation • EACL 2021 • Ziqian Zeng, Yangqiu Song
In this paper, we propose a posterior regularization framework for the variational approach to the weakly supervised sentiment analysis to better control the posterior distribution of the label assignment.
1 code implementation • AKBC 2020 • Hongliang Dai, Yangqiu Song, Xin Li
We find that, in some cases, existing neural fine-grained entity typing models may ignore the semantic information in the context that is important for typing.
1 code implementation • LREC 2022 • Xinran Zhao, Hongming Zhang, Yangqiu Song
Pronoun Coreference Resolution (PCR) is the task of resolving pronominal expressions to all mentions they refer to.
1 code implementation • 9 Feb 2023 • Zizheng Lin, Hongming Zhang, Yangqiu Song
In this work, we propose to use global constraints with prompting to effectively tackles event argument classification without any annotation and task-specific training.
1 code implementation • 16 Aug 2023 • Qi Hu, Yangqiu Song
Additionally, we introduce a novel regularization to enforce the independence of the encoders.
no code implementations • 16 May 2017 • Rui Meng, Hao Xin, Lei Chen, Yangqiu Song
In our work, we propose a system, called crowdsourced subjective knowledge acquisition (CoSKA), for subjective knowledge acquisition powered by crowdsourcing and existing KBs.
no code implementations • 8 May 2017 • Yangqiu Song, Dan Roth
In this paper, we will discuss how to use the existing general-purpose world knowledge to enhance machine learning processes, by enriching the features or reducing the labeling work.
no code implementations • 26 Feb 2017 • Tong Che, Yan-ran Li, Ruixiang Zhang, R. Devon Hjelm, Wenjie Li, Yangqiu Song, Yoshua Bengio
Despite the successes in capturing continuous distributions, the application of generative adversarial networks (GANs) to discrete settings, like natural language tasks, is rather restricted.
no code implementations • 13 Nov 2016 • Yangqiu Song, Stephen Mayhew, Dan Roth
We use a word-level dictionary to convert documents in a SWL to a large-Wikipedia language (LWLs), and then perform CLDDC based on the LWL's Wikipedia.
no code implementations • 30 Jul 2016 • Chenguang Wang, Yangqiu Song, Dan Roth, Ming Zhang, Jiawei Han
We provide three ways to specify the world knowledge to domains by resolving the ambiguity of the entities and their types, and represent the data with world knowledge as a heterogeneous information network.
no code implementations • 13 Dec 2015 • Yangxin Zhong, Shixia Liu, Xiting Wang, Jiannan Xiao, Yangqiu Song
To facilitate users in analyzing the flow, we present a method to model the flow behaviors that aims at identifying the lead-lag relationships between word clusters of different user groups.
no code implementations • SEMEVAL 2017 • Yichun Yin, Yangqiu Song, Ming Zhang
In this paper, we propose a simple and effective ensemble method to further boost the performances of neural models.
no code implementations • EMNLP 2017 • Jinxing Yu, Xun Jian, Hao Xin, Yangqiu Song
Word embeddings have attracted much attention recently.
no code implementations • EMNLP 2017 • Yichun Yin, Yangqiu Song, Ming Zhang
Document-level multi-aspect sentiment classification is an important task for customer relation management.
no code implementations • NeurIPS 2018 • Ruixiang Zhang, Tong Che, Zoubin Ghahramani, Yoshua Bengio, Yangqiu Song
In this paper, we propose a conceptually simple and general framework called MetaGAN for few-shot learning problems.
no code implementations • 6 Mar 2019 • Wanyun Cui, Yanghua Xiao, Haixun Wang, Yangqiu Song, Seung-won Hwang, Wei Wang
Based on these templates, our QA system KBQA effectively supports binary factoid questions, as well as complex questions which are composed of a series of binary factoid questions.
no code implementations • 7 Sep 2019 • Yu He, Yangqiu Song, Jian-Xin Li, Cheng Ji, Jian Peng, Hao Peng
Heterogeneous information network (HIN) embedding has gained increasing interests recently.
1 code implementation • 11 Feb 2020 • Wenyi Xiao, Huan Zhao, Vincent W. Zheng, Yangqiu Song
In this paper, we study the fundamental problem of random walk for network embedding.
no code implementations • 9 May 2020 • Qiaoan Chen, Hao Gu, Lingling Yi, Yishi Lin, Peng He, Chuan Chen, Yangqiu Song
Experiments on three data sets verify the effectiveness of our model and show that it outperforms state-of-the-art social recommendation methods.
no code implementations • 4 Aug 2020 • Haotian Li, Huan Wei, Yong Wang, Yangqiu Song, Huamin Qu
Specifically, we model the relationship between students and questions using student interactions to construct the student-interaction-question network and further present a new GNN model, called R^2GCN, which intrinsically works for the heterogeneous networks, to achieve generalizable student performance prediction in interactive online question pools.
no code implementations • EMNLP 2020 • Hongming Zhang, Muhao Chen, Haoyu Wang, Yangqiu Song, Dan Roth
Computational and cognitive studies of event understanding suggest that identifying, comprehending, and predicting events depend on having structured representations of a sequence of events and on conceptualizing (abstracting) its components into (soft) event categories.
no code implementations • 14 Jan 2021 • Zhixian Chen, Tengfei Ma, Zhihua Jin, Yangqiu Song, Yang Wang
Graph convolutional networks (GCNs) have achieved great success on graph-structured data.
no code implementations • 6 Feb 2021 • Zhixian Chen, Tengfei Ma, Yangqiu Song, Yang Wang
In this paper, we propose an innovative node representation learning framework, Wasserstein Graph Neural Network (WGNN), to mitigate the problem.
no code implementations • 4 Sep 2021 • Zizheng Lin, Haowen Ke, Ngo-Yin Wong, Jiaxin Bai, Yangqiu Song, Huan Zhao, Junpeng Ye
To tackle this challenge, we develop a multi-relational graph based MTL model called Heterogeneous Multi-Task Graph Isomorphism Network (HMTGIN) which efficiently solves heterogeneous CQA tasks.
no code implementations • CRAC (ACL) 2021 • Hongming Zhang, Xinran Zhao, Yangqiu Song
Pronoun Coreference Resolution (PCR) is the task of resolving pronominal expressions to all mentions they refer to.
1 code implementation • 28 Aug 2022 • Yinghua Zhang, Yangqiu Song, Kun Bai, Qiang Yang
To successfully attack fine-tuned models under both settings, we propose to first train an adversarial generator against the source model, which adopts an encoder-decoder architecture and maps a clean input to an adversarial example.
no code implementations • 12 Oct 2022 • Hongming Zhang, Yintong Huo, Yanai Elazar, Yangqiu Song, Yoav Goldberg, Dan Roth
We first align commonsense tasks with relevant knowledge from commonsense knowledge bases and ask humans to annotate whether the knowledge is enough or not.
1 code implementation • COLING 2022 • Ying Su, Hongming Zhang, Yangqiu Song, Tong Zhang
As a key natural language processing (NLP) task, word sense disambiguation (WSD) evaluates how well NLP models can understand the lexical semantics of words under specific contexts.
1 code implementation • 24 Oct 2022 • Changlong Yu, Tianyi Xiao, Lingpeng Kong, Yangqiu Song, Wilfred Ng
Though linguistic knowledge emerges during large-scale language model pretraining, recent work attempt to explicitly incorporate human-defined linguistic priors into task-specific fine-tuning.
no code implementations • 20 Dec 2022 • Tianqing Fang, Wenxuan Zhou, Fangyu Liu, Hongming Zhang, Yangqiu Song, Muhao Chen
However, data augmentation may introduce noisy data that impairs training.
no code implementations • 28 Apr 2023 • Chunkit Chan, Jiayang Cheng, Weiqi Wang, Yuxin Jiang, Tianqing Fang, Xin Liu, Yangqiu Song
This paper aims to quantitatively evaluate the performance of ChatGPT, an interactive large language model, on inter-sentential relations such as temporal relations, causal relations, and discourse relations.
no code implementations • 19 May 2023 • Jie Huang, Yifan Gao, Zheng Li, Jingfeng Yang, Yangqiu Song, Chao Zhang, Zining Zhu, Haoming Jiang, Kevin Chen-Chuan Chang, Bing Yin
We propose and study Complementary Concept Generation (CCGen): given a concept of interest, e. g., "Digital Cameras", generating a list of complementary concepts, e. g., 1) Camera Lenses 2) Batteries 3) Camera Cases 4) Memory Cards 5) Battery Chargers.
no code implementations • 24 May 2023 • Tianqing Fang, Zhaowei Wang, Wenxuan Zhou, Hongming Zhang, Yangqiu Song, Muhao Chen
Event temporal reasoning aims at identifying the temporal relations between two or more events.
no code implementations • 16 Oct 2023 • Haoran Li, Yulin Chen, Jinglong Luo, Yan Kang, Xiaojin Zhang, Qi Hu, Chunkit Chan, Yangqiu Song
The advancement of large language models (LLMs) has significantly enhanced the ability to effectively tackle various downstream NLP tasks and unify these tasks into generative pipelines.
no code implementations • 7 Nov 2023 • Haoran Li, Dadi Guo, Donghao Li, Wei Fan, Qi Hu, Xin Liu, Chunkit Chan, Duanyi Yao, Yangqiu Song
Lastly, P-Bench performs existing privacy attacks on LMs with pre-defined privacy objectives as the empirical evaluation results.
no code implementations • 13 Nov 2023 • Qineng Wang, ZiHao Wang, Ying Su, Yangqiu Song
Two ways has been discussed to unlock the reasoning capability of a large language model.
no code implementations • 21 Dec 2023 • Jiaxin Bai, Chen Luo, Zheng Li, Qingyu Yin, Yangqiu Song
In this paper, we introduce the task of logical session complex query answering, where sessions are treated as hyperedges of items, and we formulate the problem of complex intention understanding as a task of logical session complex queries answering (LS-CQA) on an aggregated hypergraph of sessions, items, and attributes.
no code implementations • 25 Dec 2023 • Jiaxin Bai, Yicheng Wang, Tianshi Zheng, Yue Guo, Xin Liu, Yangqiu Song
Although many applications require the use of knowledge for explanations, the utilization of abductive reasoning in conjunction with structured knowledge, such as a knowledge graph, remains largely unexplored.
no code implementations • 25 Dec 2023 • Qi Hu, Haoran Li, Jiaxin Bai, ZiHao Wang, Yangqiu Song
Neural graph databases (NGDBs) have emerged as a powerful paradigm that combines the strengths of graph databases (GDBs) and neural networks to enable efficient storage, retrieval, and analysis of graph-structured data which can be adaptively trained with LLMs.
1 code implementation • 23 Dec 2023 • Qi Hu, Yangqiu Song
However, the recommendation model learned by a common FedRec may still be vulnerable to private information leakage risks, particularly attribute inference attacks, which means that the attacker can easily infer users' personal attributes from the learned model.
no code implementations • 31 Jan 2024 • Ying Su, Jipeng Zhang, Yangqiu Song, Tong Zhang
To facilitate the evaluation of pruned subgraphs, we also propose a graph attention network (GAT) based module to reason with the subgraph data.
no code implementations • 15 Feb 2024 • Ying Su, Tianqing Fang, Huiru Xiao, Weiqi Wang, Yangqiu Song, Tong Zhang, Lei Chen
In this paper, we propose to adopt textual entailment to find implicit entailment relations between CSKG nodes, to effectively densify the subgraph connecting nodes within the same conceptual class, which indicates a similar level of plausibility.
no code implementations • 22 Feb 2024 • Qi Hu, Weifeng Jiang, Haoran Li, ZiHao Wang, Jiaxin Bai, Qianren Mao, Yangqiu Song, Lixin Fan, JianXin Li
An entity can be involved in various knowledge graphs and reasoning on multiple KGs and answering complex queries on multi-source KGs is important in discovering knowledge cross graphs.
no code implementations • 28 Feb 2024 • Qineng Wang, ZiHao Wang, Ying Su, Hanghang Tong, Yangqiu Song
Recent progress in LLMs discussion suggests that multi-agent discussion improves the reasoning abilities of LLMs.
no code implementations • 28 Feb 2024 • Feihong Lu, Weiqi Wang, Yangyifei Luo, Ziqin Zhu, Qingyun Sun, Baixuan Xu, Haochen Shi, Shiqi Gao, Qian Li, Yangqiu Song, JianXin Li
However, understanding the intention behind social media posts remains challenging due to the implicitness of intentions in social media posts, the need for cross-modality understanding of both text and images, and the presence of noisy information such as hashtags, misspelled words, and complicated abbreviations.
no code implementations • 3 Mar 2024 • Weizhi Fei, ZiHao Wang, Hang Yin, Yang Duan, Hanghang Tong, Yangqiu Song
To bridge this gap, we study the setting of soft queries on uncertain knowledge, which is motivated by the establishment of soft constraint programming.
no code implementations • 12 Mar 2024 • Tianqing Fang, Zeming Chen, Yangqiu Song, Antoine Bosselut
Event commonsense reasoning requires the ability to reason about the relationship between events, as well as infer implicit context underlying that relationship.
no code implementations • 15 Mar 2024 • Hang Yin, ZiHao Wang, Yangqiu Song
To answer complex queries under incomplete knowledge, learning-based Complex Query Answering (CQA) models are proposed to directly learn from the query-answer samples to avoid the direct traversal of incomplete graph data.