1 code implementation • 9 Jan 2025 • Wenqian Cui, Xiaoqi Jiao, Ziqiao Meng, Irwin King
With the growing demand for developing speech-based interaction models, end-to-end Spoken Language Models (SLMs) have emerged as a promising solution.
1 code implementation • 3 Jan 2025 • Weizhi Zhang, Yuanchen Bei, Liangwei Yang, Henry Peng Zou, Peilin Zhou, Aiwei Liu, Yinghui Li, Hao Chen, Jianling Wang, Yu Wang, Feiran Huang, Sheng Zhou, Jiajun Bu, Allen Lin, James Caverlee, Fakhri Karray, Irwin King, Philip S. Yu
Cold-start problem is one of the long-standing challenges in recommender systems, focusing on accurately modeling new or interaction-limited users or items to provide better recommendations.
1 code implementation • 2 Jan 2025 • Wenqian Cui, Xiangling Fu, Shaohui Liu, Mingjun Gu, Xien Liu, Ji Wu, Irwin King
Disease name normalization is an important task in the medical domain.
no code implementations • 31 Dec 2024 • Menglin Yang, Jialin Chen, Yifei Zhang, Jiahong Liu, Jiasheng Zhang, Qiyao Ma, Harshit Verma, Qianru Zhang, Min Zhou, Irwin King, Rex Ying
The rapid advancement of foundation modelslarge-scale neural networks trained on diverse, extensive datasetshas revolutionized artificial intelligence, enabling unprecedented advancements across domains such as natural language processing, computer vision, and scientific discovery.
no code implementations • 21 Dec 2024 • Minda Hu, Qiyuan Zhang, YuFei Wang, Bowei He, Hongru Wang, Jingyan Zhou, Liangyou Li, Yasheng Wang, Chen Ma, Irwin King
However, existing IFT datasets often contain knowledge that is inconsistent with LLMs' internal knowledge learned from the pre-training phase, which can greatly affect the efficacy of IFT.
no code implementations • 12 Nov 2024 • Muzhi Li, Cehao Yang, Chengjin Xu, Xuhui Jiang, Yiyan Qi, Jian Guo, Ho-fung Leung, Irwin King
Firstly, the Retrieval module gathers supporting triples from the KG, collects plausible candidate answers from a base embedding model, and retrieves context for each related entity.
no code implementations • 25 Oct 2024 • Yifei Zhang, Hao Zhu, Aiwei Liu, Han Yu, Piotr Koniusz, Irwin King
This work advances parameter-efficient fine-tuning for LLMs, and offers a promising solution for adapting LLMs to downstream tasks while optimizing performance and efficiency.
1 code implementation • 22 Oct 2024 • Muzhi Li, Cehao Yang, Chengjin Xu, Zixing Song, Xuhui Jiang, Jian Guo, Ho-fung Leung, Irwin King
With sufficient guidance from proper prompts and supervised fine-tuning, CATS activates the strong semantic understanding and reasoning capabilities of large language models to assess the existence of query triples, which consist of two modules.
1 code implementation • 7 Oct 2024 • Dianzhi Yu, Xinni Zhang, Yankai Chen, Aiwei Liu, Yifei Zhang, Philip S. Yu, Irwin King
Continual learning (CL) aims to empower machine learning models to learn continually from new data, while building upon previously acquired knowledge without forgetting.
1 code implementation • 5 Oct 2024 • Menglin Yang, Aosong Feng, Bo Xiong, Jihong Liu, Irwin King, Rex Ying
Through extensive experiments, we demonstrate that HypLoRA significantly enhances the performance of LLMs on reasoning tasks, particularly for complex reasoning problems.
1 code implementation • 1 Oct 2024 • Wenqian Cui, Dianzhi Yu, Xiaoqi Jiao, Ziqiao Meng, Guangyan Zhang, Qichao Wang, Yiwen Guo, Irwin King
To address these issues, Speech Language Models (SpeechLMs) -- end-to-end models that generate speech without converting from text -- have emerged as a promising alternative.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
1 code implementation • 16 Sep 2024 • Hezhe Qiao, Hanghang Tong, Bo An, Irwin King, Charu Aggarwal, Guansong Pang
To this end, in this work we aim to present a comprehensive review of deep learning approaches for GAD.
1 code implementation • 8 Sep 2024 • Leyi Pan, Aiwei Liu, Yijian Lu, Zitian Gao, Yichen Di, Shiyu Huang, Lijie Wen, Irwin King, Philip S. Yu
Watermarking algorithms for large language models (LLMs) have attained high accuracy in detecting LLM-generated text.
no code implementations • 17 Aug 2024 • Yankai Chen, Yixiang Fang, Yifei Zhang, Chenhao Ma, Yang Hong, Irwin King
Our findings indicate the learning effectiveness of incorporating hashing techniques within the exploration of bipartite graph reception fields, as opposed to simply treating hashing as post-processing to output embeddings.
1 code implementation • 2 Jul 2024 • Yali Fu, Jindong Li, Jiahong Liu, Qianli Xing, Qi Wang, Irwin King
To the best of our knowledge, this is the first work to simultaneously apply hypergraph with node group information and hyperbolic geometry in this field.
1 code implementation • 1 Jul 2024 • Menglin Yang, Harshit Verma, Delvin Ce Zhang, Jiahong Liu, Irwin King, Rex Ying
Our experimental results confirm the effectiveness and efficiency of Hypformer across various datasets, demonstrating its potential as an effective and scalable solution for large-scale data representation and large models.
1 code implementation • 25 Jun 2024 • Zexuan Qiu, Zijing Ou, Bin Wu, Jingjing Li, Aiwei Liu, Irwin King
Augmenting Large Language Models (LLMs) with retrieved external knowledge has proven effective for improving the factual accuracy of generated responses.
no code implementations • 17 Jun 2024 • Minda Hu, Licheng Zong, Hongru Wang, Jingyan Zhou, Jingjing Li, Yichen Gao, Kam-Fai Wong, Yu Li, Irwin King
By combining the reasoning capabilities of LLMs with the effectiveness of tree search, SeRTS boosts the zero-shot performance of retrieving high-quality and informative results for RAG.
no code implementations • 17 Jun 2024 • Minda Hu, Bowei He, YuFei Wang, Liangyou Li, Chen Ma, Irwin King
Large language models (LLMs) have demonstrated remarkable performance on various natural language processing tasks.
1 code implementation • 14 Jun 2024 • Conghao Xiong, Hao Chen, Hao Zheng, Dong Wei, Yefeng Zheng, Joseph J. Y. Sung, Irwin King
To address these issues, we propose a Biased Progressive Encoding (BPE) paradigm, performing encoding and fusion simultaneously.
no code implementations • 23 May 2024 • Yueen Ma, Zixing Song, Yuzheng Zhuang, Jianye Hao, Irwin King
Built upon unimodal neural networks, numerous multi-modal models have been introduced to address a range of tasks such as visual question answering, image captioning, and speech recognition.
1 code implementation • 16 May 2024 • Leyi Pan, Aiwei Liu, Zhiwei He, Zitian Gao, Xuandong Zhao, Yijian Lu, Binglin Zhou, Shuliang Liu, Xuming Hu, Lijie Wen, Irwin King, Philip S. Yu
However, the abundance of LLM watermarking algorithms, their intricate mechanisms, and the complex evaluation procedures and perspectives pose challenges for researchers and the community to easily experiment with, understand, and assess the latest advancements.
no code implementations • 15 Apr 2024 • Junfan Li, Zheshun Wu, Zenglin Xu, Irwin King
We consider online model selection with decentralized data over $M$ clients, and study the necessity of collaboration among clients.
1 code implementation • 12 Apr 2024 • Muzhi Li, Minda Hu, Irwin King, Ho-fung Leung
The Knowledge Graph Entity Typing (KGET) task aims to predict missing type annotations for entities in knowledge graphs.
2 code implementations • 20 Mar 2024 • Yijian Lu, Aiwei Liu, Dianzhi Yu, Jingjing Li, Irwin King
From the experiments, we demonstrate that our EWD can achieve better detection performance in low-entropy scenarios, and our method is also general and can be applied to texts with different entropy distributions.
1 code implementation • 6 Mar 2024 • Zexuan Qiu, Jingjing Li, Shijue Huang, Xiaoqi Jiao, Wanjun Zhong, Irwin King
Developing Large Language Models (LLMs) with robust long-context capabilities has been the recent research focus, resulting in the emergence of long-context LLMs proficient in Chinese.
no code implementations • 19 Feb 2024 • Yankai Chen, Yixiang Fang, Qiongyan Wang, Xin Cao, Irwin King
Node importance estimation problem has been studied conventionally with homogeneous network topology analysis.
no code implementations • 6 Feb 2024 • Qing Li, Zhihang Hu, YiXuan Wang, Lei LI, Yimin Fan, Irwin King, Le Song, Yu Li
Central to our focus is the application of FMs to specific biological problems, aiming to guide the research community in choosing appropriate FMs for their research needs.
1 code implementation • 14 Jan 2024 • Zexuan Qiu, Jiahong Liu, Yankai Chen, Irwin King
Existing unsupervised deep product quantization methods primarily aim for the increased similarity between different views of the identical image, whereas the delicate multi-level semantic similarities preserved between images are overlooked.
no code implementations • 13 Dec 2023 • Aiwei Liu, Leyi Pan, Yijian Lu, Jingjing Li, Xuming Hu, Xi Zhang, Lijie Wen, Irwin King, Hui Xiong, Philip S. Yu
This paper conducts a comprehensive survey of the current state of text watermarking technology, covering four main aspects: (1) an overview and comparison of different text watermarking techniques; (2) evaluation methods for text watermarking algorithms, including their detectability, impact on text or LLM quality, robustness under target or untargeted attacks; (3) potential application scenarios for text watermarking technology; (4) current challenges and future directions for text watermarking.
no code implementations • 30 Oct 2023 • Xiangli Yang, Xinglin Pan, Irwin King, Zenglin Xu
To address the GCD without knowing the class number of unlabeled dataset, we propose a co-training-based framework that encourages clustering consistency.
no code implementations • 27 Oct 2023 • Yifei Zhang, Hao Zhu, Jiahong Liu, Piotr Koniusz, Irwin King
We show that in the hyperbolic space one has to address the leaf- and height-level uniformity which are related to properties of trees, whereas in the ambient space of the hyperbolic manifold, these notions translate into imposing an isotropic ring density towards boundaries of Poincar\'e ball.
no code implementations • 13 Oct 2023 • Hongru Wang, Minda Hu, Yang Deng, Rui Wang, Fei Mi, Weichao Wang, Yasheng Wang, Wai-Chung Kwan, Irwin King, Kam-Fai Wong
Open-domain dialogue system usually requires different sources of knowledge to generate more informative and evidential responses.
no code implementations • 29 Aug 2023 • Jingyan Zhou, Minda Hu, Junan Li, Xiaoying Zhang, Xixin Wu, Irwin King, Helen Meng
Making moral judgments is an essential step toward developing ethical AI systems.
3 code implementations • 30 Jul 2023 • Aiwei Liu, Leyi Pan, Xuming Hu, Shu'ang Li, Lijie Wen, Irwin King, Philip S. Yu
Experiments demonstrate that our algorithm attains high detection accuracy and computational efficiency through neural networks.
1 code implementation • 7 Jul 2023 • Ming Jin, Huan Yee Koh, Qingsong Wen, Daniele Zambon, Cesare Alippi, Geoffrey I. Webb, Irwin King, Shirui Pan
In this survey, we provide a comprehensive review of graph neural networks for time series analysis (GNN4TS), encompassing four fundamental dimensions: forecasting, classification, anomaly detection, and imputation.
no code implementations • 3 Jul 2023 • Yueen Ma, Dafeng Chi, Jingjing Li, Kai Song, Yuzheng Zhuang, Irwin King
The natural language generation domain has witnessed great success thanks to Transformer models.
no code implementations • 28 Jun 2023 • Ziqiao Meng, Peilin Zhao, Yang Yu, Irwin King
Reaction and retrosynthesis prediction are fundamental tasks in computational chemistry that have recently garnered attention from both the machine learning and drug discovery communities.
1 code implementation • 15 Jun 2023 • Menglin Yang, Min Zhou, Rex Ying, Yankai Chen, Irwin King
To address this, we propose a simple yet effective method, hyperbolic informed embedding (HIE), by incorporating cost-free hierarchical information deduced from the hyperbolic distance of the node to origin (i. e., induced hyperbolic norm) to advance existing \hlms.
no code implementations • 5 Jun 2023 • Ziqiao Meng, Peilin Zhao, Yang Yu, Irwin King
However, the current non-autoregressive decoder does not satisfy two essential rules of electron redistribution modeling simultaneously: the electron-counting rule and the symmetry rule.
1 code implementation • 2 Jun 2023 • Wenqian Cui, Xiangling Fu, Shaohui Liu, Mingjun Gu, Xien Liu, Ji Wu, Irwin King
Nevertheless, the most significant obstacle to existing disease name normalization systems is the severe shortage of training data.
no code implementations • 26 May 2023 • Xuming Hu, Aiwei Liu, Zeqi Tan, Xin Zhang, Chenwei Zhang, Irwin King, Philip S. Yu
These techniques neither preserve the semantic consistency of the original sentences when rule-based augmentations are adopted, nor preserve the syntax structure of sentences when expressing relations using seq2seq models, resulting in less diverse augmentations.
no code implementations • 25 May 2023 • Xuming Hu, Zhijiang Guo, Zhiyang Teng, Irwin King, Philip S. Yu
Multimodal relation extraction (MRE) is the task of identifying the semantic relationships between two entities based on the context of the sentence image pair.
1 code implementation • 16 May 2023 • Xinyu Fu, Irwin King
In federated heterogeneous graph learning, clients may have private graph schemas.
no code implementations • 8 May 2023 • Yankai Chen, Yifei Zhang, Menglin Yang, Zixing Song, Chen Ma, Irwin King
Maximizing the user-item engagement based on vectorized embeddings is a standard procedure of recent recommender models.
1 code implementation • 2 May 2023 • Xuming Hu, Zhaochen Hong, Chenwei Zhang, Irwin King, Philip S. Yu
Relation extraction (RE) aims to extract potential relations according to the context of two entities, thus, deriving rational contexts from sentences plays an important role.
no code implementations • 1 Apr 2023 • Yankai Chen, Yixiang Fang, Yifei Zhang, Irwin King
We propose an end-to-end Bipartite Graph Convolutional Hashing approach, namely BGCH, which consists of three novel and effective modules: (1) adaptive graph convolutional hashing, (2) latent feature dispersion, and (3) Fourier serialized gradient estimation.
1 code implementation • 10 Mar 2023 • Conghao Xiong, Yi Lin, Hao Chen, Hao Zheng, Dong Wei, Yefeng Zheng, Joseph J. Y. Sung, Irwin King
Despite incorporating the target features during training, the teacher model tends to overlook them under the inherent domain shift and task discrepancy.
no code implementations • 21 Feb 2023 • Yifei Zhang, Dun Zeng, Jinglong Luo, Zenglin Xu, Irwin King
Trustworthy artificial intelligence (AI) technology has revolutionized daily life and greatly benefited human society.
1 code implementation • 19 Jan 2023 • Conghao Xiong, Hao Chen, Joseph J. Y. Sung, Irwin King
Multiple Instance Learning (MIL) and transformers are increasingly popular in histopathology Whole Slide Image (WSI) classification.
no code implementations • 14 Jan 2023 • Zhihang Hu, Qinze Yu, Yucheng Guo, Taifeng Wang, Irwin King, Xin Gao, Le Song, Yu Li
While previous methods reported fair performance, their models usually do not take advantage of multi-modal data and they are unable to handle new drugs or cell lines.
no code implementations • 12 Dec 2022 • Minda Hu, Muzhi Li, Yasheng Wang, Irwin King
In order to address this problem, we propose a novel Momentum Contrastive pRe-training fOr queStion anSwering (MCROSS) method for extractive QA.
1 code implementation • 4 Dec 2022 • Menglin Yang, Min Zhou, Lujia Pan, Irwin King
The prevalence of tree-like structures, encompassing hierarchical structures and power law distributions, exists extensively in real-world applications, including recommendation systems, ecosystems, financial networks, social networks, etc.
no code implementations • 2 Dec 2022 • Yifei Zhang, Hao Zhu, Zixing Song, Piotr Koniusz, Irwin King
Although augmentations (e. g., perturbation of graph edges, image crops) boost the efficiency of Contrastive Learning (CL), feature level augmentation is another plausible, complementary yet not well researched strategy.
1 code implementation • 23 Nov 2022 • Xinyu Fu, Irwin King
Heterogeneous graph neural networks (HGNNs) were proposed for representation learning on structural data with multiple types of nodes and edges.
no code implementations • 11 Nov 2022 • Xuming Hu, Shiao Meng, Chenwei Zhang, Xiangli Yang, Lijie Wen, Irwin King, Philip S. Yu
Low-Resource Information Extraction (LRIE) strives to use unsupervised data, reducing the required resources and human annotation.
no code implementations • 8 Nov 2022 • Min Zhou, Menglin Yang, Lujia Pan, Irwin King
We first give a brief introduction to graph representation learning as well as some preliminary Riemannian and hyperbolic geometry.
no code implementations • 28 Sep 2022 • Xinni Zhang, Yankai Chen, Cuiyun Gao, Qing Liao, Shenglin Zhao, Irwin King
Incorporating knowledge graphs (KGs) as side information in recommendation has recently attracted considerable attention.
1 code implementation • 19 Jul 2022 • Menglin Yang, Zhihao LI, Min Zhou, Jiahong Liu, Irwin King
The results reveal that (1) tail items get more emphasis in hyperbolic space than that in Euclidean space, but there is still ample room for improvement; (2) head items receive modest attention in hyperbolic space, which could be considerably improved; (3) and nonetheless, the hyperbolic models show more competitive performance than Euclidean models.
3 code implementations • 4 Jul 2022 • Tao Shen, Zhihang Hu, Siqi Sun, Di Liu, Felix Wong, Jiuming Wang, Jiayang Chen, YiXuan Wang, Liang Hong, Jin Xiao, Liangzhen Zheng, Tejas Krishnamoorthi, Irwin King, Sheng Wang, Peng Yin, James J. Collins, Yu Li
Accurate prediction of RNA three-dimensional (3D) structure remains an unsolved challenge.
1 code implementation • 25 Jun 2022 • Yueen Ma, Zixing Song, Xuming Hu, Jingjing Li, Yifei Zhang, Irwin King
As it is intractable for data augmentation to fully capture the structural information of the ConcreteGraph due to a large amount of potential concept pairs, we further introduce a novel Graph Component Contrastive Learning framework to implicitly learn the complete structure of the ConcreteGraph.
no code implementations • 16 Jun 2022 • Langzhang Liang, Zenglin Xu, Zixing Song, Irwin King, Jieping Ye
In detail, by studying the long-tailed distribution of node degrees in the graph, we propose a novel normalization method for GNNs, which is termed ResNorm (\textbf{Res}haping the long-tailed distribution into a normal-like distribution via \textbf{norm}alization).
1 code implementation • 9 Jun 2022 • Yifei Zhang, Hao Zhu, Zixing Song, Piotr Koniusz, Irwin King
In this paper, we show that the node embedding obtained via the graph augmentations is highly biased, somewhat limiting contrastive models from learning discriminative features for downstream tasks.
no code implementations • 5 Jun 2022 • Yankai Chen, Huifeng Guo, Yingxue Zhang, Chen Ma, Ruiming Tang, Jingjie Li, Irwin King
Learning vectorized embeddings is at the core of various recommender systems for user-item matching.
no code implementations • 26 May 2022 • Dun Zeng, Shiyu Liu, Siqi Liang, Zonghang Li, Hui Wang, Irwin King, Zenglin Xu
However, privacy information could be leaked from uploaded gradients and be exposed to malicious attackers or an honest-but-curious server.
1 code implementation • Findings (NAACL) 2022 • Yifan Gao, Qingyu Yin, Zheng Li, Rui Meng, Tong Zhao, Bing Yin, Irwin King, Michael R. Lyu
Keyphrase generation is the task of automatically predicting keyphrases given a piece of long text.
1 code implementation • 18 Apr 2022 • Menglin Yang, Min Zhou, Jiahong Liu, Defu Lian, Irwin King
Hyperbolic space offers a spacious room to learn embeddings with its negative curvature and metric properties, which can well fit data with tree-like structures.
1 code implementation • In2Writing (ACL) 2022 • Jingjing Li, Zichao Li, Tao Ge, Irwin King, Michael R. Lyu
In this approach, we simply fine-tune a pre-trained Transformer with masked language modeling and attribute classification.
2 code implementations • 1 Apr 2022 • Jiayang Chen, Zhihang Hu, Siqi Sun, Qingxiong Tan, YiXuan Wang, Qinze Yu, Licheng Zong, Liang Hong, Jin Xiao, Tao Shen, Irwin King, Yu Li
Non-coding RNA structure and function are essential to understanding various biological processes, such as cell signaling, gene expression, and post-transcriptional regulations.
1 code implementation • 28 Feb 2022 • Menglin Yang, Min Zhou, Zhihao LI, Jiahong Liu, Lujia Pan, Hui Xiong, Irwin King
Graph neural networks generalize conventional neural networks to graph-structured data and have received widespread attention due to their impressive representation ability.
no code implementations • 16 Feb 2022 • Feng Xia, Lei Wang, Tao Tang, Xin Chen, Xiangjie Kong, Giles Oatley, Irwin King
In each non-output layer of the GCN, this framework uses a hub attention mechanism to assign new weights to connected non-hub vertices based on their common information with hub vertices.
no code implementations • 13 Feb 2022 • Yifei Zhang, Hao Zhu, Ziqiao Meng, Piotr Koniusz, Irwin King
However, in the updating stage, all nodes share the same updating function.
no code implementations • 3 Dec 2021 • Yankai Chen, Yifei Zhang, Yingxue Zhang, Huifeng Guo, Jingjie Li, Ruiming Tang, Xiuqiang He, Irwin King
In this work, we study the problem of representation learning for recommendation with 1-bit quantization.
no code implementations • 30 Sep 2021 • Haoli Bai, Lu Hou, Lifeng Shang, Xin Jiang, Irwin King, Michael R. Lyu
Experiments on GLUE and SQuAD benchmarks show that our proposed PTQ solution not only performs close to QAT, but also enjoys significant reductions in training time, memory overhead, and data consumption.
no code implementations • 28 Sep 2021 • Yao Ma, Shilin Zhao, Weixiao Wang, Yaoman Li, Irwin King
This survey provides a comprehensive overview of the multimodality-based meta-learning landscape in terms of the methodologies and applications.
no code implementations • 5 Sep 2021 • Yankai Chen, Yaming Yang, Yujing Wang, Jing Bai, Xiangchen Song, Irwin King
However, simply integrating KGs in current KG-based RS models is not necessarily a guarantee to improve the recommendation performance, which may even weaken the holistic model capability.
Click-Through Rate Prediction
Knowledge-Aware Recommendation
+1
no code implementations • 14 Aug 2021 • Yankai Chen, Menglin Yang, Yingxue Zhang, Mengchen Zhao, Ziqiao Meng, Jianye Hao, Irwin King
Aiming to alleviate data sparsity and cold-start problems of traditional recommender systems, incorporating knowledge graphs (KGs) to supplement auxiliary information has recently gained considerable attention.
1 code implementation • 7 Aug 2021 • Hou Pong Chan, Lu Wang, Irwin King
We study controllable text summarization which allows users to gain control on a particular attribute (e. g., length limit) of the generated summaries.
1 code implementation • 3 Aug 2021 • Wang Chen, Piji Li, Hou Pong Chan, Irwin King
The supporting utterance flow modeling helps to generate a coherent summary by smoothly shifting the focus from the former utterances to the later ones.
1 code implementation • 8 Jul 2021 • Menglin Yang, Min Zhou, Marcus Kalander, Zengfeng Huang, Irwin King
To explore these properties of a complex temporal network, we propose a hyperbolic temporal graph network (HTGN) that fully takes advantage of the exponential capacity and hierarchical awareness of hyperbolic geometry.
1 code implementation • ACL 2021 • Wang Chen, Piji Li, Irwin King
Our metric consists of a centrality-weighted relevance score and a self-referenced redundancy score.
1 code implementation • 19 Jun 2021 • Hou Pong Chan, Irwin King
This framework first selects salient sentences and then independently condenses each of the selected sentences into a concise version.
1 code implementation • CVPR 2021 • Weibin Wu, Yuxin Su, Michael R. Lyu, Irwin King
Although deep neural networks (DNNs) have achieved tremendous performance in diverse vision challenges, they are surprisingly susceptible to adversarial examples, which are born of intentionally perturbing benign samples in a human-imperceptible fashion.
1 code implementation • 16 Jun 2021 • Xianghong Fang, Haoli Bai, Jian Li, Zenglin Xu, Michael Lyu, Irwin King
We further design discrete latent space for the variational attention and mathematically show that our model is free from posterior collapse.
no code implementations • 8 Jun 2021 • Pengpeng Liu, Michael R. Lyu, Irwin King, Jia Xu
Then, a self-supervised learning framework is constructed: confident predictions from teacher models are served as annotations to guide the student model to learn optical flow for those less confident predictions.
1 code implementation • ACL 2021 • Wenxiang Jiao, Xing Wang, Zhaopeng Tu, Shuming Shi, Michael R. Lyu, Irwin King
In this work, we propose to improve the sampling procedure by selecting the most informative monolingual sentences to complement the parallel data.
no code implementations • 28 Feb 2021 • Xiangli Yang, Zixing Song, Irwin King, Zenglin Xu
Deep semi-supervised learning is a fast-growing field with a range of practical applications.
1 code implementation • 27 Feb 2021 • Menglin Yang, Ziqiao Meng, Irwin King
As a matter of fact, this smoothing technique can not only encourage must-link node pairs to get closer but also push cannot-link pairs to shrink together, which potentially cause serious feature shrink or oversmoothing problem, especially when stacking graph convolution in multiple layers or steps.
1 code implementation • 26 Feb 2021 • Zixing Song, Xiangli Yang, Zenglin Xu, Irwin King
An important class of SSL methods is to naturally represent data as graphs such that the label information of unlabelled samples can be inferred from the graphs, which corresponds to graph-based semi-supervised learning (GSSL) methods.
2 code implementations • 17 Feb 2021 • Yifan Gao, Jingjing Li, Chien-Sheng Wu, Michael R. Lyu, Irwin King
On our created OR-ShARC dataset, MUDERN achieves the state-of-the-art performance, outperforming existing single-passage conversational machine reading models as well as a new multi-passage conversational machine reading baseline by a large margin.
no code implementations • 19 Jan 2021 • Thomas K. F. Chiu, Helen Meng, Ching-Sing Chai, Irwin King, Savio Wong, Yeung Yam
Background: AI4Future is a cross-sector project that engages five major partners - CUHK Faculty of Engineering and Faculty of Education, Hong Kong secondary schools, the government and the AI industry.
no code implementations • 17 Jan 2021 • Yankai Chen, Yaozu Wu, Shicheng Ma, Irwin King
With the rapid development of biomedical software and hardware, a large amount of relational data interlinking genes, proteins, chemical components, drugs, diseases, and symptoms has been collected for modern biomedical research.
1 code implementation • ACL 2021 • Haoli Bai, Wei zhang, Lu Hou, Lifeng Shang, Jing Jin, Xin Jiang, Qun Liu, Michael Lyu, Irwin King
In this paper, we propose BinaryBERT, which pushes BERT quantization to the limit by weight binarization.
1 code implementation • NeurIPS 2020 • Jiaxing Wang, Haoli Bai, Jiaxiang Wu, Xupeng Shi, Junzhou Huang, Irwin King, Michael Lyu, Jian Cheng
Nevertheless, it is unclear how parameter sharing affects the searching process.
no code implementations • 23 Nov 2020 • Yaoman Li, Irwin King
In this work, we propose a method to automate the deep GNNs design.
1 code implementation • EMNLP 2020 • Yue Wang, Jing Li, Michael R. Lyu, Irwin King
Further analyses show that our multi-head attention is able to attend information from various aspects and boost classification or generation in diverse scenarios.
no code implementations • 10 Oct 2020 • Xixian Chen, Haiqin Yang, Shenglin Zhao, Michael R. Lyu, Irwin King
Estimating covariance matrix from massive high-dimensional and distributed data is significant for various real-world applications.
no code implementations • 10 Oct 2020 • Xixian Chen, Haiqin Yang, Shenglin Zhao, Michael R. Lyu, Irwin King
Data-dependent hashing methods have demonstrated good performance in various machine learning applications to learn a low-dimensional representation from the original data.
no code implementations • 9 Oct 2020 • Pengpeng Liu, Xintong Han, Michael Lyu, Irwin King, Jia Xu
We present a self-supervised learning approach to learning monocular 3D face reconstruction with a pose guidance network (PGN).
1 code implementation • EMNLP 2020 • Wenxiang Jiao, Xing Wang, Shilin He, Irwin King, Michael R. Lyu, Zhaopeng Tu
First, we train an identification model on the original training data, and use it to distinguish inactive examples and active examples by their sentence-level output probabilities.
1 code implementation • EMNLP 2020 • Yifan Gao, Chien-Sheng Wu, Jingjing Li, Shafiq Joty, Steven C. H. Hoi, Caiming Xiong, Irwin King, Michael R. Lyu
Based on the learned EDU and entailment representations, we either reply to the user our final decision "yes/no/irrelevant" of the initial question, or generate a follow-up question to inquiry more information.
no code implementations • Findings of the Association for Computational Linguistics 2020 • Yifan Gao, Piji Li, Wei Bi, Xiaojiang Liu, Michael R. Lyu, Irwin King
Besides a small number of high-resource sentence functions, a large portion of sentence functions is infrequent.
1 code implementation • Findings of the Association for Computational Linguistics 2020 • Wenxiang Jiao, Michael R. Lyu, Irwin King
Emotion Recognition in Conversations (ERC) aims to predict the emotional state of speakers in conversations, which is essentially a text classification task.
Emotion Recognition in Conversation
General Classification
+2
no code implementations • 23 Aug 2020 • Cuiyun Gao, Jichuan Zeng, Zhiyuan Wen, David Lo, Xin Xia, Irwin King, Michael R. Lyu
Experiments on popular apps from Google Play and Apple's App Store demonstrate the effectiveness of MERIT in identifying emerging app issues, improving the state-of-the-art method by 22. 3% in terms of F1-score.
no code implementations • 17 Aug 2020 • Jiaying Liu, Feng Xia, Lei Wang, Bo Xu, Xiangjie Kong, Hanghang Tong, Irwin King
The advisor-advisee relationship represents direct knowledge heritage, and such relationship may not be readily available from academic libraries and search engines.
no code implementations • ACL 2020 • Jichuan Zeng, Xi Victoria Lin, Caiming Xiong, Richard Socher, Michael R. Lyu, Irwin King, Steven C. H. Hoi
Natural language interfaces to databases (NLIDB) democratize end user access to relational data.
no code implementations • NeurIPS 2020 • Jingjing Li, Zichao Li, Lili Mou, Xin Jiang, Michael R. Lyu, Irwin King
In this work, we present TGLS, a novel framework to unsupervised Text Generation by Learning from Search.
1 code implementation • ACL 2020 • Yifan Gao, Chien-Sheng Wu, Shafiq Joty, Caiming Xiong, Richard Socher, Irwin King, Michael Lyu, Steven C. H. Hoi
The goal of conversational machine reading is to answer user questions given a knowledge base text which may require asking clarification questions.
1 code implementation • 2 Jun 2020 • Hou Pong Chan, Wang Chen, Irwin King
Review summarization aims at generating a concise summary that describes the key opinions and sentiment of a review, while sentiment classification aims to predict a sentiment label indicating the sentiment attitude of a review.
1 code implementation • 26 May 2020 • Yifan Gao, Chien-Sheng Wu, Shafiq Joty, Caiming Xiong, Richard Socher, Irwin King, Michael R. Lyu, Steven C. H. Hoi
The goal of conversational machine reading is to answer user questions given a knowledge base text which may require asking clarification questions.
1 code implementation • EMNLP 2020 • Yue Wang, Shafiq Joty, Michael R. Lyu, Irwin King, Caiming Xiong, Steven C. H. Hoi
By contrast, in this work, we propose VD-BERT, a simple yet effective framework of unified vision-dialog Transformer that leverages the pretrained BERT language models for Visual Dialog tasks.
no code implementations • 21 Apr 2020 • Xianghong Fang, Haoli Bai, Zenglin Xu, Michael Lyu, Irwin King
Variational autoencoders have been widely applied for natural language generation, however, there are two long-standing problems: information under-representation and posterior collapse.
1 code implementation • ACL 2020 • Wang Chen, Hou Pong Chan, Piji Li, Irwin King
A new setting is recently introduced into this problem, in which, given a document, the model needs to predict a set of keyphrases and simultaneously determine the appropriate number of keyphrases to produce.
1 code implementation • CVPR 2020 • Pengpeng Liu, Irwin King, Michael Lyu, Jia Xu
In this paper, we propose a unified method to jointly learn optical flow and stereo matching.
1 code implementation • 10 Feb 2020 • Cuiyun Gao, Jichuan Zeng, Xin Xia, David Lo, Michael R. Lyu, Irwin King
Previous studies showed that replying to a user review usually has a positive effect on the rating that is given by the user to the app.
no code implementations • 10 Feb 2020 • Jichuan Zeng, Jing Li, Yulan He, Cuiyun Gao, Michael R. Lyu, Irwin King
In our world with full of uncertainty, debates and argumentation contribute to the progress of science and society.
2 code implementations • 5 Feb 2020 • Xinyu Fu, Jiani Zhang, Ziqiao Meng, Irwin King
A large number of real-world graphs or networks are inherently heterogeneous, involving a diversity of node types and relation types.
Ranked #1 on
Node Clustering
on IMDb
1 code implementation • 21 Nov 2019 • Haoli Bai, Jiaxiang Wu, Irwin King, Michael Lyu
The core challenge of few shot network compression lies in high estimation errors from the original network during inference, since the compressed network can easily over-fits on the few training instances.
1 code implementation • 20 Nov 2019 • Wenxiang Jiao, Michael R. Lyu, Irwin King
We propose an Attention Gated Hierarchical Memory Network (AGHMN) to address the problems of prior work: (1) Commonly used convolutional neural networks (CNNs) for utterance feature extraction are less compatible in the memory modules; (2) Unidirectional gated recurrent units (GRUs) only allow each historical utterance to have context before it, preventing information propagation in the opposite direction; (3) The Soft Attention for summarizing loses the positional and ordering information of memories, regardless of how the memory bank is built.
Ranked #50 on
Emotion Recognition in Conversation
on IEMOCAP
no code implementations • 21 Oct 2019 • Wenxiang Jiao, Irwin King, Michael R. Lyu
Word2Vec is the most popular model for word representation and has been widely investigated in literature.
1 code implementation • 20 Oct 2019 • Wenxiang Jiao, Michael R. Lyu, Irwin King
Witnessing the success of transfer learning in natural language process (NLP), we propose to pre-train a context-dependent encoder (CoDE) for ULER by learning from unlabeled conversation data.
no code implementations • IJCNLP 2019 • Jingjing Li, Yifan Gao, Lidong Bing, Irwin King, Michael R. Lyu
Question generation (QG) is the task of generating a question from a reference sentence and a specified answer within the sentence.
1 code implementation • ACL 2019 • Yifan Gao, Piji Li, Irwin King, Michael R. Lyu
The coreference alignment modeling explicitly aligns coreferent mentions in conversation history with corresponding pronominal references in generated questions, which makes generated questions interconnected to conversation history.
1 code implementation • ACL 2019 • Hou Pong Chan, Wang Chen, Lu Wang, Irwin King
To address this problem, we propose a reinforcement learning (RL) approach for keyphrase generation, with an adaptive reward function that encourages a model to generate both sufficient and accurate keyphrases.
2 code implementations • ACL 2019 • Yue Wang, Jing Li, Hou Pong Chan, Irwin King, Michael R. Lyu, Shuming Shi
Further discussions show that our model learns meaningful topics, which interprets its superiority in social media keyphrase generation.
no code implementations • 27 May 2019 • Jiani Zhang, Xingjian Shi, Shenglin Zhao, Irwin King
We propose a new STAcked and Reconstructed Graph Convolutional Networks (STAR-GCN) architecture to learn node representations for boosting the performance in recommender systems, especially in the cold start scenario.
1 code implementation • 24 May 2019 • J. D. Curtó, I. C. Zarza, Kris Kitani, Irwin King, Michael R. Lyu
Dr. of Crosswise proposes a new architecture to reduce over-parametrization in Neural Networks.
1 code implementation • NAACL 2019 • Yue Wang, Jing Li, Irwin King, Michael R. Lyu, Shuming Shi
Automatic hashtag annotation plays an important role in content understanding for microblog posts.
1 code implementation • CVPR 2019 • Pengpeng Liu, Michael Lyu, Irwin King, Jia Xu
We present a self-supervised learning approach for optical flow.
Ranked #7 on
Optical Flow Estimation
on KITTI 2012
1 code implementation • NAACL 2019 • Wenxiang Jiao, Haiqin Yang, Irwin King, Michael R. Lyu
In this paper, we address three challenges in utterance-level emotion recognition in dialogue systems: (1) the same word can deliver different emotions in different contexts; (2) some emotions are rarely seen in general dialogues; (3) long-range contextual information is hard to be effectively captured.
1 code implementation • NAACL 2019 • Wang Chen, Hou Pong Chan, Piji Li, Lidong Bing, Irwin King
For further exploiting the power of extraction and retrieval, we propose a neural-based merging module to combine and re-rank the predicted keyphrases from the enhanced generative model, the extractive model, and the retrieved keyphrases.
1 code implementation • TACL 2019 • Jichuan Zeng, Jing Li, Yulan He, Cuiyun Gao, Michael R. Lyu, Irwin King
This paper presents an unsupervised framework for jointly modeling topic content and discourse behavior in microblog conversations.
1 code implementation • 25 Feb 2019 • Pengpeng Liu, Irwin King, Michael R. Lyu, Jia Xu
We present DDFlow, a data distillation approach to learning optical flow estimation from unlabeled data.
no code implementations • NeurIPS 2018 • Han Shao, Xiaotian Yu, Irwin King, Michael R. Lyu
In this paper, under a weaker assumption on noises, we study the problem of \underline{lin}ear stochastic {\underline b}andits with h{\underline e}avy-{\underline t}ailed payoffs (LinBET), where the distributions have finite moments of order $1+\epsilon$, for some $\epsilon\in (0, 1]$.
no code implementations • EMNLP 2018 • Hou Pong Chan, Irwin King
This task has been formulated as a reinforcement learning problem, in which the reward of the agent is the sum of positive responses received by the recommended comments.
no code implementations • EMNLP 2018 • Jichuan Zeng, Jing Li, Yan Song, Cuiyun Gao, Michael R. Lyu, Irwin King
Many classification models work poorly on short texts due to data sparsity.
2 code implementations • 8 Sep 2018 • Yifan Gao, Lidong Bing, Piji Li, Irwin King, Michael R. Lyu
We investigate the task of distractor generation for multiple choice reading comprehension questions from examinations.
no code implementations • 26 Aug 2018 • Wang Chen, Yifan Gao, Jiani Zhang, Irwin King, Michael R. Lyu
Keyphrase generation (KG) aims to generate a set of keyphrases given a document, which is a fundamental task in natural language processing (NLP).
no code implementations • 10 Jul 2018 • Yifan Gao, Lidong Bing, Wang Chen, Michael R. Lyu, Irwin King
We investigate the difficulty levels of questions in reading comprehension datasets such as SQuAD, and propose a new question generation setting, named Difficulty-controllable Question Generation (DQG).
no code implementations • 27 Jun 2018 • Hui Xu, Yuxin Su, Zirui Zhao, Yangfan Zhou, Michael R. Lyu, Irwin King
Our obfuscation approach is very effective to protect the critical structure of a deep learning model from being exposed to attackers.
Cryptography and Security
1 code implementation • 20 Mar 2018 • Jiani Zhang, Xingjian Shi, Junyuan Xie, Hao Ma, Irwin King, Dit-yan Yeung
We propose a new network architecture, Gated Attention Networks (GaAN), for learning on graphs.
Ranked #1 on
Node Property Prediction
on ogbn-proteins
1 code implementation • 27 Nov 2017 • Jian Li, Yue Wang, Michael R. Lyu, Irwin King
Intelligent code completion has become an essential research task to accelerate modern software development.
no code implementations • 26 Nov 2017 • Pengpeng Liu, Xiaojuan Qi, Pinjia He, Yikang Li, Michael R. Lyu, Irwin King
Image completion has achieved significant progress due to advances in generative adversarial networks (GANs).
1 code implementation • 17 Nov 2017 • Joachim D. Curtó, Irene C. Zarza, Fernando de la Torre, Irwin King, Michael R. Lyu
Generative Adversarial Networks (GANs) convergence in a high-resolution setting with a computational constrain of GPU memory capacity (from 12GB to 24 GB) has been beset with difficulty due to the known lack of convergence rate stability.
Ranked #1 on
Image Generation
on CelebA 128x128
(MS-SSIM metric)
no code implementations • CIKM 2017 • Jiajun Cheng, Shenglin Zhao, Jiani Zhang, Irwin King, Xin Zhang, Hui Wang
However, the prior work only attends to the sentiment information and ignores the aspect-related information in the text, which may cause mismatching between the sentiment words and the aspects when an unrelated sentiment word is semantically meaningful for the given aspect.
no code implementations • ICML 2017 • Xixian Chen, Michael R. Lyu, Irwin King
Estimating covariance matrices is a fundamental technique in various domains, most notably in machine learning and signal processing.
1 code implementation • 22 May 2017 • Yuxin Su, Irwin King, Michael Lyu
First, we design a concept called \textit{ideal candidate document} to introduce metric learning algorithm to query-independent model.
1 code implementation • 24 Nov 2016 • Jiani Zhang, Xingjian Shi, Irwin King, Dit-yan Yeung
Knowledge Tracing (KT) is a task of tracing evolving knowledge state of students with respect to one or more concepts as they engage in a sequence of learning activities.
no code implementations • 11 Nov 2016 • Guangxi Li, Zenglin Xu, Linnan Wang, Jinmian Ye, Irwin King, Michael Lyu
Probabilistic Temporal Tensor Factorization (PTTF) is an effective algorithm to model the temporal tensor data.
no code implementations • 3 Jul 2016 • Shenglin Zhao, Irwin King, Michael R. Lyu
Then, we present a comprehensive review in three aspects: influential factors for POI recommendation, methodologies employed for POI recommendation, and different tasks in POI recommendation.
no code implementations • NeurIPS 2014 • Shouyuan Chen, Tian Lin, Irwin King, Michael R. Lyu, Wei Chen
We also establish a general problem-dependent lower bound for the CPE problem.
no code implementations • NeurIPS 2013 • Shouyuan Chen, Michael R. Lyu, Irwin King, Zenglin Xu
For the noisy cases, we also prove error bounds for a constrained convex program for recovering the tensors.