no code implementations • CCL 2020 • Yu Li, Guangyou Zhou
面向知识库的自动问答是自然语言处理的一项重要任务, 它旨在对用户提出的自然语言形式问题给出精炼、准确的回复。目前由于缺少数据集、特征不一致等因素, 导致难以使用通用的数据和方法实现领域知识库问答。因此, 本文将“问题意图”视作不同领域问答可能存在的共同特征, 将“问题”与三元组知识库中“关系谓词”的映射过程作为问答核心工作。为了考虑多种层次的语义避免重要信息的损失, 本文分别将“基于门控卷积的深层语义”和“基于交互注意力机制的浅层语义”两个方面通过门控感知机制相融合。我们在NLPCC-ICCPOL 2016 KBQA数据集上的实验表明, 本文提出的方法与现有的基于CDSSM和BDSSM相比, 效能有明显的提升。此外, 本文通过构造天文常识知识库, 将问题与关系谓词映射模型移植到特定领域, 结合Bi-LSTM-CRF模型构建了天文常识自动问答系统。
no code implementations • Findings (NAACL) 2022 • Bowen Yang, Cong Han, Yu Li, Lei Zuo, Zhou Yu
In this paper, we propose a simple yet effective architecture comprising a pre-trained language model (PLM) and an item metadata encoder to integrate the recommendation and the dialog generation better.
1 code implementation • LREC 2022 • Yuru Jiang, Yang Xu, Yuhang Zhan, WeiKai He, Yilin Wang, Zixuan Xi, Meiyun Wang, Xinyu Li, Yu Li, Yanchao Yu
We describe a new freely available Chinese multi-party dialogue dataset for automatic extraction of dialogue-based character relationships.
no code implementations • 27 Nov 2023 • He Cao, Zijing Liu, Xingyu Lu, Yuan YAO, Yu Li
The rapid evolution of artificial intelligence in drug discovery encounters challenges with generalization and extensive training, yet Large Language Models (LLMs) offer promise in reshaping interactions with complex molecular data.
Ranked #19 on
Molecule Captioning
on ChEBI-20
no code implementations • 13 Nov 2023 • Yachun Mi, Yu Li, Yan Shu, Chen Hui, Puchao Zhou, Shaohui Liu
In this paper, we propose CLiF-VQA, which considers both features related to human feelings and spatial features of videos.
no code implementations • 1 Nov 2023 • You Zhou, Xiujing Lin, Xiang Zhang, Maolin Wang, Gangwei Jiang, Huakang Lu, Yupeng Wu, Kai Zhang, Zhe Yang, Kehang Wang, Yongduo Sui, Fengwei Jia, Zuoli Tang, Yao Zhao, Hongxuan Zhang, Tiannuo Yang, Weibo Chen, Yunong Mao, Yi Li, De Bao, Yu Li, Hongrui Liao, Ting Liu, Jingwen Liu, Jinchi Guo, Xiangyu Zhao, Ying WEI, Hong Qian, Qi Liu, Xiang Wang, Wai Kin, Chan, Chenliang Li, Yusen Li, Shiyu Yang, Jining Yan, Chao Mou, Shuai Han, Wuxia Jin, Guannan Zhang, Xiaodong Zeng
To tackle the challenges of computing resources and environmental impact of AI, Green Computing has become a hot research topic.
1 code implementation • 20 Oct 2023 • Han Jiang, Rui Wang, Zhihua Wei, Yu Li, Xinpeng Wang
Furthermore, our in-depth analysis verifies that the advanced selection of review subsets and the two-stage training scheme are vital to boosting the summarization performance.
no code implementations • 18 Oct 2023 • Xinhua Cheng, Tianyu Yang, Jianan Wang, Yu Li, Lei Zhang, Jian Zhang, Li Yuan
Recent text-to-3D generation methods achieve impressive 3D content creation capacity thanks to the advances in image diffusion models and optimizing strategies.
no code implementations • 12 Oct 2023 • Haohan Weng, Tianyu Yang, Jianan Wang, Yu Li, Tong Zhang, C. L. Philip Chen, Lei Zhang
Large image diffusion models enable novel view synthesis with high quality and excellent zero-shot capability.
no code implementations • 28 Sep 2023 • Yu Li, Shang Qu, Jili Shen, Shangchao Min, Zhou Yu
Chatbots have become popular in educational settings, revolutionizing how students interact with material and how teachers teach.
1 code implementation • 27 Sep 2023 • Chuanyang Zheng, Haiming Wang, Enze Xie, Zhengying Liu, Jiankai Sun, Huajian Xin, Jianhao Shen, Zhenguo Li, Yu Li
In addition, we introduce Conjecture Correction, an error feedback mechanism designed to interact with prover to refine formal proof conjectures with prover error messages.
Ranked #1 on
Automated Theorem Proving
on miniF2F-test
(Pass@100 metric)
1 code implementation • 29 Jul 2023 • Zhendong Yang, Ailing Zeng, Chun Yuan, Yu Li
Different from the previous self-knowledge distillation, this stage finetunes the student's head with only 20% training time as a plug-and-play training strategy.
Ranked #1 on
2D Human Pose Estimation
on COCO-WholeBody
(using extra training data)
no code implementations • ICCV 2023 • Yunfei Liu, Lijian Lin, Fei Yu, Changyin Zhou, Yu Li
Audio-driven portrait animation aims to synthesize portrait videos that are conditioned by given audio.
no code implementations • 20 Jun 2023 • Liying Lu, Tianke Zhang, Yunfei Liu, Xuangeng Chu, Yu Li
Consequently, their generalization capability remains limited.
1 code implementation • 2 Jun 2023 • Le Zhang, Jiayang Chen, Tao Shen, Yu Li, Siqi Sun
The field of protein folding research has been greatly advanced by deep learning methods, with AlphaFold2 (AF2) demonstrating exceptional performance and atomic-level precision.
1 code implementation • 19 Apr 2023 • Chuanyang Zheng, Zhengying Liu, Enze Xie, Zhenguo Li, Yu Li
The performance of Large Language Models (LLMs) in reasoning tasks depends heavily on prompt design, with Chain-of-Thought (CoT) and self-consistency being critical methods that enhance this ability.
Ranked #2 on
Math Word Problem Solving
on SVAMP
no code implementations • 11 Apr 2023 • Kun Qian, Ryan Shea, Yu Li, Luke Kutszik Fryer, Zhou Yu
Along with the development of systems for natural language understanding and generation, dialog systems have been widely adopted for language learning and practicing.
1 code implementation • CVPR 2023 • Jing Lin, Ailing Zeng, Haoqian Wang, Lei Zhang, Yu Li
It is challenging to perform this task with a single network due to resolution issues, i. e., the face and hands are usually located in extremely small regions.
Ranked #1 on
3D Human Reconstruction
on EHF
1 code implementation • 24 Mar 2023 • Hao Shi, Yu Li, Kailun Yang, Jiaming Zhang, Kunyu Peng, Alina Roitberg, Yaozu Ye, Huajian Ni, Kaiwei Wang, Rainer Stiefelhagen
This paper raises the new task of Fisheye Semantic Completion (FSC), where dense texture, structure, and semantics of a fisheye image are inferred even beyond the sensor field-of-view (FoV).
1 code implementation • ICCV 2023 • Zhendong Yang, Ailing Zeng, Zhe Li, Tianke Zhang, Chun Yuan, Yu Li
We decompose the KD loss and find the non-target loss from it forces the student's non-target logits to match the teacher's, but the sum of the two non-target logits is different, preventing them from being identical.
no code implementations • ICCV 2023 • Ziyang Yuan, Yiming Zhu, Yu Li, Hongyu Liu, Chun Yuan
We leverage the inherent properties of EG3D's latent space to design a discriminator and a background depth regularization.
2 code implementations • 14 Mar 2023 • Yiming Tan, Dehai Min, Yu Li, Wenbo Li, Nan Hu, Yongrui Chen, Guilin Qi
ChatGPT is a powerful large language model (LLM) that covers knowledge resources such as Wikipedia and supports natural language question answering using its own knowledge.
Ranked #1 on
Question Answering
on GraphQuestions
no code implementations • 10 Feb 2023 • Yu Li, Yi Zhang, Weijia Wu, Zimu Zhou, Qiang Li
Such personalized opening sentence generation is challenging because (i) there are limited historical samples for conversation topic recommendation in online insurance sales and (ii) existing text generation schemes often fail to support customized topic ordering based on user preferences.
no code implementations • 8 Feb 2023 • Xiangyu Wen, Yu Li, Wei Jiang, Qiang Xu
Various watermarking techniques are proposed to protect such intellectual properties (IPs), wherein the DNN providers implant secret information into the model so that they can later claim IP ownership by retrieving their embedded watermarks with some dedicated trigger inputs.
no code implementations • 4 Feb 2023 • Feng Xue, Yu Li, Deyin Liu, Yincen Xie, Lin Wu, Richang Hong
However, generalizing these methods to unseen speakers incurs catastrophic performance degradation due to the limited number of speakers in training bank and the evident visual variations caused by the shape/color of lips for different speakers.
no code implementations • 14 Jan 2023 • Zhihang Hu, Qinze Yu, Yucheng Guo, Taifeng Wang, Irwin King, Xin Gao, Le Song, Yu Li
While previous methods reported fair performance, their models usually do not take advantage of multi-modal data and they are unable to handle new drugs or cell lines.
1 code implementation • ICCV 2023 • Fan Zhang, ShaoDi You, Yu Li, Ying Fu
This learned prior contains location information of rain streaks and, when injected into deraining models, can significantly improve their performance.
no code implementations • CVPR 2023 • Zheng Chang, Shuchen Weng, Peixuan Zhang, Yu Li, Si Li, Boxin Shi
Language-based colorization produces plausible colors consistent with the language description provided by the user.
no code implementations • ICCV 2023 • Tianke Zhang, Xuangeng Chu, Yunfei Liu, Lijian Lin, Zhendong Yang, Zhengzhuo Xu, Chengkun Cao, Fei Yu, Changyin Zhou, Chun Yuan, Yu Li
However, the current deep learning-based methods face significant challenges in achieving accurate reconstruction with disentangled facial parameters and ensuring temporal stability in single-frame methods for 3D face tracking on video data.
no code implementations • 20 Dec 2022 • Yu Li, Baolin Peng, Pengcheng He, Michel Galley, Zhou Yu, Jianfeng Gao
In this work, we propose DIONYSUS (dynamic input optimization in pre-training for dialogue summarization), a pre-trained encoder-decoder model for summarizing dialogues in any new domain.
no code implementations • 16 Dec 2022 • Wei Sun, Chengao Liu, Linyan Zhang, Yu Li, Pengxu Wei, Chang Liu, Jialing Zou, Jianbin Jiao, Qixiang Ye
Optimizing a convolutional neural network (CNN) for camouflaged object detection (COD) tends to activate local discriminative regions while ignoring complete object extent, causing the partial activation issue which inevitably leads to missing or redundant regions of objects.
no code implementations • 30 Nov 2022 • Yu Li, Muxi Chen, Yannan Liu, Daojing He, Qiang Xu
Third, performing data selection in the SSAL setting can achieve a significant and consistent performance improvement, especially with abundant unlabeled data.
2 code implementations • 26 Nov 2022 • Yu Li, Dongwei Ren, Xinya Shu, WangMeng Zuo
First, in the deblurring module, a bi-directional optical flow-based deformation is introduced to tolerate spatial misalignment between deblurred and ground-truth images.
1 code implementation • ECCV 2022 • Shuchen Weng, Jimeng Sun, Yu Li, Si Li, Boxin Shi
Automatic image colorization is an ill-posed problem with multi-modal uncertainty, and there remains two main challenges with previous methods: incorrect semantic colors and under-saturation.
1 code implementation • 22 Oct 2022 • David Gros, Yu Li, Zhou Yu
Dialog systems are often designed or trained to output human-like responses.
1 code implementation • 11 Oct 2022 • Xiangguang Chen, Ye Zhu, Yu Li, Bingtao Fu, Lei Sun, Ying Shan, Shan Liu
Unlike previous works, our framework is data efficient, which requires a small amount of matting ground-truth to learn to estimate high quality object mattes.
1 code implementation • 10 Oct 2022 • Fan Zhang, ShaoDi You, Yu Li, Ying Fu
In this paper, we propose GTAV-NightRain dataset, which is a large-scale synthetic night-time rain streak removal dataset.
1 code implementation • 6 Sep 2022 • Zhendong Yang, Zhe Li, Ailing Zeng, Zexian Li, Chun Yuan, Yu Li
In this paper, we explore the way of feature-based distillation for ViT.
1 code implementation • 22 Aug 2022 • Zhendong Yang, Zhe Li, Yuan Gong, Tianke Zhang, Shanshan Lao, Chun Yuan, Yu Li
Furthermore, we smooth students' target output to treat it as the soft target for training without teachers and propose a teacher-free new KD loss (tf-NKD).
1 code implementation • 21 Aug 2022 • Sheng Xu, Junkang Wei, Yu Li
Besides, SSBlazer is a lightweight model with robust cross-species generalization ability in the cross-species evaluation, which enables the large-scale genome-wide application in diverse species.
1 code implementation • 6 Aug 2022 • Xiaolong Luo, Wanzhong Song, Songlin Bai, Yu Li, Zhihe Zhao
This system necessitates a robust spatial phase unwrapping (SPU) algorithm.
no code implementations • 31 Jul 2022 • Yu Li, Chun-Yen Chen, Dian Yu, Sam Davidson, Ryan Hou, Xun Yuan, Yinghua Tan, Derek Pham, Zhou Yu
This paper reports on progress towards building an online language learning tool to provide learners with conversational experience by using dialog systems as conversation practice partners.
1 code implementation • 8 Jul 2022 • Yu Li, Anisha Parsan, Bill Wang, Penghao Dong, Shanshan Yao, Ruwen Qin
A base model for a group of five authorized subjects is trained and tested on the inspection keyword dataset collected by this study.
no code implementations • 4 Jul 2022 • Tao Shen, Zhihang Hu, Zhangzhi Peng, Jiayang Chen, Peng Xiong, Liang Hong, Liangzhen Zheng, YiXuan Wang, Irwin King, Sheng Wang, Siqi Sun, Yu Li
When E2Efold-3D is coupled with the experimental techniques, the RNA structure prediction field can be greatly advanced.
no code implementations • 26 May 2022 • Dazhao Du, Bing Su, Yu Li, Zhongang Qi, Lingyu Si, Ying Shan
Most state-of-the-art methods focus on designing temporal convolution-based models, but the inflexibility of temporal convolutions and the difficulties in modeling long-term temporal dependencies restrict the potential of these models.
Ranked #1 on
Action Segmentation
on 50Salads
no code implementations • 16 May 2022 • Junkang Wei, Jin Xiao, Siyuan Chen, Licheng Zong, Xin Gao, Yu Li
The rapid growth in the number of experimental and predicted protein structures and more complicated protein structures challenge users in computational biology for utilizing the structural information and protein surface property representation.
1 code implementation • 26 Apr 2022 • Yu Li, Yaling Yi, Dongwei Ren, Qince Li, WangMeng Zuo
Generally, DPANet is an encoder-decoder with skip-connections, where two branches with shared parameters in the encoder are employed to extract and align deep features from left and right views, and one decoder is adopted to fuse aligned features for predicting the sharp image.
1 code implementation • 25 Apr 2022 • Shuo Zhang, Junzhou Zhao, Pinghui Wang, Yu Li, Yi Huang, Junlan Feng
Multi-action dialog policy (MADP), which generates multiple atomic dialog actions per turn, has been widely applied in task-oriented dialog systems to provide expressive and efficient system responses.
3 code implementations • CVPR 2022 • Shusheng Yang, Xinggang Wang, Yu Li, Yuxin Fang, Jiemin Fang, Wenyu Liu, Xun Zhao, Ying Shan
To effectively and efficiently model the crucial temporal information within a video clip, we propose a Temporally Efficient Vision Transformer (TeViT) for video instance segmentation (VIS).
Ranked #27 on
Video Instance Segmentation
on OVIS validation
1 code implementation • 1 Apr 2022 • Jiayang Chen, Zhihang Hu, Siqi Sun, Qingxiong Tan, YiXuan Wang, Qinze Yu, Licheng Zong, Liang Hong, Jin Xiao, Tao Shen, Irwin King, Yu Li
Non-coding RNA structure and function are essential to understanding various biological processes, such as cell signaling, gene expression, and post-transcriptional regulations.
no code implementations • 15 Mar 2022 • Kairui Bao, Wen Yao, Xiaoya Zhang, Wei Peng, Yu Li
Second, a physics-driven CNN surrogate with partial differential equation (PDE) residuals as a loss function is utilized for fast meshing (meshing surrogate); then, we present a data-driven surrogate model based on the multi-level reduced-order method, aiming to learn solutions of temperature field in the above regular computational plane (thermal surrogate).
1 code implementation • 15 Feb 2022 • Tao Wang, Jun Hao Liew, Yu Li, Yunpeng Chen, Jiashi Feng
Unlike the original per grid cell object masks, SODAR is implicitly supervised to learn mask representations that encode geometric structure of nearby objects and complement adjacent representations with context.
1 code implementation • 24 Jan 2022 • Yijun Yang, Ruiyuan Gao, Yu Li, Qiuxia Lai, Qiang Xu
For legitimate inputs that are correctly inferred, the synthetic output tries to reconstruct the input.
1 code implementation • 24 Jan 2022 • Binjie Zhang, Yixiao Ge, Yantao Shen, Yu Li, Chun Yuan, Xuyuan Xu, Yexin Wang, Ying Shan
In contrast, hot-refresh model upgrades deploy the new model immediately and then gradually improve the retrieval accuracy by backfilling the gallery on-the-fly.
1 code implementation • CVPR 2022 • Kun-Peng Ning, Xun Zhao, Yu Li, Sheng-Jun Huang
To tackle this open-set annotation (OSA) problem, we propose a new active learning framework called LfOSA, which boosts the classification performance with an effective sampling strategy to precisely detect examples from known classes for annotation.
no code implementations • NAACL 2022 • Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao
To address these challenges, we present PLUG, a language model that homogenizes different knowledge sources to a unified knowledge representation for knowledge-grounded dialogue generation tasks.
1 code implementation • 15 Dec 2021 • Bowen Yang, Cong Han, Yu Li, Lei Zuo, Zhou Yu
The encoder learns to map item metadata to embeddings that can reflect the semantic information in the dialog context.
1 code implementation • 5 Dec 2021 • Xuesong Wang, Zhihang Hu, Tingyang Yu, Ruijie Wang, Yumeng Wei, Juan Shu, Jianzhu Ma, Yu Li
Our approach can efficiently map the above data with high sparsity and noise from different spaces to a low-dimensional manifold in a unified space, making the downstream alignment and integration straightforward.
1 code implementation • 18 Nov 2021 • Pengfei Zhang, Zhengyuan Jiang, YiXuan Wang, Yu Li
Essentially, instead of denoising the data explicitly, we add simulated noise to the training data and force the deep learning model to produce similar and stable representations for both the noise-free data and the distorted data.
no code implementations • 11 Nov 2021 • Qinze Yu, Zhihang Dong, Xingyu Fan, Licheng Zong, Yu Li
Identifying the targets of an antimicrobial peptide is a fundamental step in studying the innate immune response and combating antibiotic resistance, and more broadly, precision medicine and public health.
no code implementations • 28 Oct 2021 • Suresh Singh, Minwei Luo, Yu Li
However, we show that jointly using multiple one-class anomaly detectors to solve this problem yields poorer results as compared to training a single one-class anomaly detector on all normal object categories together.
1 code implementation • 19 Oct 2021 • Yu Song, Jianxun Lian, Shuai Sun, Hong Huang, Yu Li, Hai Jin, Xing Xie
Then we propose a hierarchical CB (HCB) algorithm to explore users' interest in the hierarchy tree.
no code implementations • ICLR 2022 • Binjie Zhang, Yixiao Ge, Yantao Shen, Yu Li, Chun Yuan, Xuyuan Xu, Yexin Wang, Ying Shan
In contrast, hot-refresh model upgrades deploy the new model immediately and then gradually improve the retrieval accuracy by backfilling the gallery on-the-fly.
1 code implementation • 23 Sep 2021 • Kai Guo, Kaixiong Zhou, Xia Hu, Yu Li, Yi Chang, Xin Wang
Graph neural networks (GNNs) have received tremendous attention due to their superiority in learning node representations.
1 code implementation • EMNLP 2021 • Chen Liu, Mengchao Zhang, Zhibin Fu, Pan Hou, Yu Li
In natural language processing (NLP), state-of-the-art (SOTA) semi-supervised learning (SSL) frameworks have shown great performance on deep pre-trained language models such as BERT, and are expected to significantly reduce the demand for manual labeling.
no code implementations • 6 Sep 2021 • Yu Li, Muhammad Monjurul Karim, Ruwen Qin
Then, exploratory analysis of location- and time-related variables of the crash report data suggests reducing fatal crashes to spatially defined groups.
1 code implementation • ICCV 2021 • Yanze Wu, Xintao Wang, Yu Li, Honglun Zhang, Xun Zhao, Ying Shan
Codes are available at https://github. com/ToTheBeginning/GCP-Colorization.
no code implementations • 9 Aug 2021 • Yu Li, Fei Xiong, Ziyi Wang, Zulong Chen, Chuanfei Xu, Yuyu Yin, Li Zhou
Therefore, in this paper, we focus on predicting users' intention destinations in online travel platforms.
1 code implementation • 7 Aug 2021 • Qiuxia Lai, Yu Li, Ailing Zeng, Minhao Liu, Hanqiu Sun, Qiang Xu
Extensive experiments show that the proposed IB-inspired spatial attention mechanism can yield attention maps that neatly highlight the regions of interest while suppressing backgrounds, and bootstrap standard DNN structures for visual recognition tasks (e. g., image classification, fine-grained recognition, cross-domain classification).
no code implementations • 5 Aug 2021 • Ziyi Wang, Wendong Xiao, Yu Li, Zulong Chen, Zhi Jiang
To alleviate this problem, existing user cold start methods either apply deep learning to build a cross-domain recommender system or map user attributes into the space of user behaviour.
1 code implementation • 31 Jul 2021 • Muhammad Monjurul Karim, Yu Li, Ruwen Qin
It confirms that the Grad-CAM chosen by this study can generate high-quality, human-interpretable saliency maps (with 1. 23 Normalized Scanpath Saliency) for explaining the crash anticipation decision.
no code implementations • 26 Jul 2021 • Junkang Wei, Siyuan Chen, Licheng Zong, Xin Gao, Yu Li
Protein-RNA interactions are of vital importance to a variety of cellular activities.
1 code implementation • 22 Jun 2021 • Shusheng Yang, Yuxin Fang, Xinggang Wang, Yu Li, Ying Shan, Bin Feng, Wenyu Liu
Recently, query based deep networks catch lots of attention owing to their end-to-end pipeline and competitive results on several fundamental computer vision tasks, such as object detection, semantic segmentation, and instance segmentation.
1 code implementation • CVPR 2021 • Fan Zhang, Yu Li, ShaoDi You, Ying Fu
Based on this idea, we propose our method which can infer motion prior for single image low light video enhancement and enforce temporal consistency.
1 code implementation • 18 Jun 2021 • Muhammad Monjurul Karim, Yu Li, Ruwen Qin, Zhaozheng Yin
Visual cues for predicting a future accident are embedded deeply in dashcam video data.
Ranked #1 on
Accident Anticipation
on CCD
2 code implementations • 18 Jun 2021 • Muhammad Monjurul Karim, Yu Li, Ruwen Qin, Zhaozheng Yin
The paper further evaluates the performance of the Multi-Net and the efficiency of the developed system.
no code implementations • ACL 2021 • David Gros, Yu Li, Zhou Yu
Humans are increasingly interacting with machines through language, sometimes in contexts where the user may not know they are talking to a machine (like over the phone or a text chatbot).
1 code implementation • ACL 2021 • Siyang Liu, Chujie Zheng, Orianna Demasi, Sahand Sabour, Yu Li, Zhou Yu, Yong Jiang, Minlie Huang
Emotional support is a crucial ability for many conversation scenarios, including social interactions, mental health support, and customer service chats.
no code implementations • NeurIPS 2021 • Yu Li, Min Li, Qiuxia Lai, Yannan Liu, Qiang Xu
To be specific, we first build a similarity graph on test instances and training samples, and we conduct graph-based semi-supervised learning to extract contextual features.
no code implementations • 10 May 2021 • Min Li, Yu Li, Ye Tian, Li Jiang, Qiang Xu
This paper presents AppealNet, a novel edge/cloud collaborative architecture that runs deep learning (DL) tasks more efficiently than state-of-the-art solutions.
4 code implementations • ICCV 2021 • Yuxin Fang, Shusheng Yang, Xinggang Wang, Yu Li, Chen Fang, Ying Shan, Bin Feng, Wenyu Liu
The key insight of QueryInst is to leverage the intrinsic one-to-one correspondence in object queries across different stages, as well as one-to-one correspondence between mask RoI features and object queries in the same stage.
Ranked #13 on
Object Detection
on COCO-O
(using extra training data)
1 code implementation • ACL 2021 • Yu Li, Josh Arnold, Feifan Yan, Weiyan Shi, Zhou Yu
We present LEGOEval, an open-source toolkit that enables researchers to easily evaluate dialogue systems in a few lines of code using the online crowdsource platform, Amazon Mechanical Turk.
no code implementations • 20 Apr 2021 • Yijun Yang, Ruiyuan Gao, Yu Li, Qiuxia Lai, Qiang Xu
Consequently, we propose a novel learning-based solution to model such contradictions for AE detection.
no code implementations • 16 Apr 2021 • Yu Li, Shirley Anugrah Hayati, Weiyan Shi, Zhou Yu
It is important for sociable recommendation dialog systems to perform as both on-task content and social content to engage users and gain their favor.
1 code implementation • ICCV 2021 • Shusheng Yang, Yuxin Fang, Xinggang Wang, Yu Li, Chen Fang, Ying Shan, Bin Feng, Wenyu Liu
For temporal information modeling in VIS, we present a novel crossover learning scheme that uses the instance feature in the current frame to pixel-wisely localize the same instance in other frames.
Ranked #26 on
Video Instance Segmentation
on OVIS validation
1 code implementation • ICLR 2021 • Boyuan Chen, Yu Li, Sunand Raghupathi, Hod Lipson
Our experiments reveal that high dimensional, high entropy labels achieve comparable accuracy to text (categorical) labels on the standard image classification task, but features learned through our label representations exhibit more robustness under various adversarial attacks and better effectiveness with a limited amount of training data.
no code implementations • EACL 2021 • Beilei Xiang, Changbing Yang, Yu Li, Alex Warstadt, Katharina Kann
CLiMP consists of sets of 1, 000 minimal pairs (MPs) for 16 syntactic contrasts in Mandarin, covering 9 major Mandarin linguistic phenomena.
no code implementations • 25 Jan 2021 • Vivek Mishra, Yu Li, Fu-Chun Zhang andStefan Kirchner
Motivated by the recent findings of unconventional superconductivity in $\mathrm{CoSi_2 / TiSi_2}$ heterostructures, we study the effect of interface induced Rashba spin orbit coupling on the conductance of a three terminal ``T" shape superconducting device.
Superconductivity Mesoscale and Nanoscale Physics
1 code implementation • CVPR 2021 • Xintao Wang, Yu Li, Honglun Zhang, Ying Shan
Blind face restoration usually relies on facial priors, such as facial geometry prior or reference prior, to restore realistic and faithful details.
Ranked #2 on
Blind Face Restoration
on CelebA-Test
no code implementations • ICLR 2021 • Bingyi Kang, Yu Li, Sa Xie, Zehuan Yuan, Jiashi Feng
Motivated by this question, we conduct a series of studies on the performance of self-supervised contrastive learning and supervised learning methods over multiple datasets where training instance distributions vary from a balanced one to a long-tailed one.
Ranked #39 on
Long-tail Learning
on CIFAR-10-LT (ρ=10)
no code implementations • NeurIPS Workshop LMCA 2020 • Hanjun Dai, Xinshi Chen, Yu Li, Xin Gao, Le Song
Recently there is a surge of interests in using graph neural networks (GNNs) to learn algorithms.
1 code implementation • 1 Jan 2021 • Tao Wang, Jun Hao Liew, Yu Li, Yunpeng Chen, Jiashi Feng
Recently proposed one-stage instance segmentation models (\emph{e. g.}, SOLO) learn to directly predict location-specific object mask with fully-convolutional networks.
no code implementations • 1 Jan 2021 • Weiyan Shi, Yu Li, Saurav Sahay, Zhou Yu
Despite the recent success of large-scale language models on various downstream NLP tasks, the repetition and inconsistency problems still persist in dialogue response generation.
no code implementations • Findings (EMNLP) 2021 • Weiyan Shi, Yu Li, Saurav Sahay, Zhou Yu
Persuasion dialogue systems reflect the machine's ability to make strategic moves beyond verbal communication, and therefore differentiate themselves from task-oriented or open-domain dialogue systems and have their own unique values.
1 code implementation • 2 Dec 2020 • Yu Li, Ming Liu, Yaling Yi, Qince Li, Dongwei Ren, WangMeng Zuo
To be specific, the reflection layer is firstly estimated due to that it generally is much simpler and is relatively easier to estimate.
no code implementations • COLING 2020 • Chunpu Xu, Yu Li, Chengming Li, Xiang Ao, Min Yang, Jinwen Tian
In this paper, we propose an Interactive key-value Memory- augmented Attention model for image Paragraph captioning (IMAP) to keep track of the attention history (salient objects coverage information) along with the update-chain of the decoder state and therefore avoid generating repetitive or incomplete image descriptions.
no code implementations • 17 Nov 2020 • Kaihui Liang, Austin Chau, Yu Li, Xueyuan Lu, Dian Yu, Mingyang Zhou, Ishan Jain, Sam Davidson, Josh Arnold, Minh Nguyen, Zhou Yu
Gunrock 2. 0 is built on top of Gunrock with an emphasis on user adaptation.
no code implementations • Findings of the Association for Computational Linguistics 2020 • Orianna Demasi, Yu Li, Zhou Yu
Suicide prevention hotline counselors aid individuals during difficult times through millions of calls and chats.
no code implementations • 23 Sep 2020 • Binjie Zhang, Yu Li, Chun Yuan, Dejing Xu, Pin Jiang, Ying Shan
The task of language-guided video temporal grounding is to localize the particular video clip corresponding to a query sentence in an untrimmed video.
no code implementations • 21 Sep 2020 • Yu Li, Min Li, Bo Luo, Ye Tian, Qiang Xu
The key to enabling such lightweight checking is that the smaller neural network only needs to produce approximate results for the initial task without sacrificing fault coverage much.
no code implementations • 16 Sep 2020 • Lijian Lin, Haosheng Chen, Honglun Zhang, Jun Liang, Yu Li, Ying Shan, Hanzi Wang
Video object detection is a tough task due to the deteriorated quality of video sequences captured under complex environments.
no code implementations • 25 Aug 2020 • Yu Li
However, in addition to the standard classification or regression problems, in bioinformatics, we often need to predict more complex structured targets, such as 2D images and 3D molecular structures.
1 code implementation • ECCV 2020 • Tao Wang, Yu Li, Bingyi Kang, Junnan Li, Junhao Liew, Sheng Tang, Steven Hoi, Jiashi Feng
Specifically, we systematically investigate performance drop of the state-of-the-art two-stage instance segmentation model Mask R-CNN on the recent long-tail LVIS dataset, and unveil that a major cause is the inaccurate classification of object proposals.
2 code implementations • CVPR 2020 • Yu Li, Tao Wang, Bingyi Kang, Sheng Tang, Chunfeng Wang, Jintao Li, Jiashi Feng
Solving long-tail large vocabulary object detection with deep learning based models is a challenging and demanding task, which is however under-explored. In this work, we provide the first systematic analysis on the underperformance of state-of-the-art models in front of long-tail distribution.
1 code implementation • ICML 2020 • Xinshi Chen, Hanjun Dai, Yu Li, Xin Gao, Le Song
Similar to algorithms, the optimal depth of a deep architecture may be different for different input instances, either to avoid ``over-thinking'', or because we want to compute less for operations converged already.
no code implementations • 18 Apr 2020 • Ruoteng Li, Xiaoyi Zhang, ShaoDi You, Yu Li
We select a large number of high-quality frames of real outdoor scenes and render haze on them using depth from stereo.
1 code implementation • ICLR 2020 • Xinshi Chen, Yu Li, Ramzan Umarov, Xin Gao, Le Song
The key idea of E2Efold is to directly predict the RNA base-pairing matrix, and use an unrolled algorithm for constrained programming as the template for deep architectures to enforce constraints.
no code implementations • ECCV 2020 • Yu Li, Zhuoran Shen, Ying Shan
Therefore, it uses constant memory regardless of the video length and costs substantially less memory and computation.
no code implementations • 25 Dec 2019 • Yu Li, Sheng Tang, Rui Zhang, Yongdong Zhang, Jintao Li, Shuicheng Yan
While in situations where two domains are asymmetric in complexity, i. e., the amount of information between two domains is different, these approaches pose problems of poor generation quality, mapping ambiguity, and model sensitivity.
no code implementations • NeurIPS 2019 • Lizhong Ding, Mengyang Yu, Li Liu, Fan Zhu, Yong liu, Yu Li, Ling Shao
DEAN can be interpreted as a GOF game between two generative networks, where one explicit generative network learns an energy-based distribution that fits the real data, and the other implicit generative network is trained by minimizing a GOF test statistic between the energy-based distribution and the generated data, such that the underlying distribution of the generated data is close to the energy-based distribution.
1 code implementation • 25 Nov 2019 • Yu Li, Kun Qian, Weiyan Shi, Zhou Yu
End-to-end task-oriented dialog models have achieved promising performance on collaborative tasks where users willingly coordinate with the system to complete a given task.
no code implementations • 23 Nov 2019 • Bo Luo, Yu Li, Lingxiao Wei, Qiang Xu
Considering the large amount of training data and know-how required to generate the network, it is more practical to use third-party DNN intellectual property (IP) cores for many designs.
2 code implementations • CVPR 2020 • Yunfei Liu, Yu Li, ShaoDi You, Feng Lu
Intrinsic image decomposition, which is an essential task in computer vision, aims to infer the reflectance and shading of the scene.
no code implementations • 18 Nov 2019 • Michael Diodato, Yu Li, Antonia Lovjer, Minsu Yeom, Albert Song, Yiyang Zeng, Abhay Khosla, Benedikt Schifferer, Manik Goyal, Iddo Drori
Predicting vehicle trajectories, angle and speed is important for safe and comfortable driving.
1 code implementation • 29 Oct 2019 • Tao Wang, Yu Li, Bingyi Kang, Junnan Li, Jun Hao Liew, Sheng Tang, Steven Hoi, Jiashi Feng
In this report, we investigate the performance drop phenomenon of state-of-the-art two-stage instance segmentation models when processing extreme long-tail training data based on the LVIS [5] dataset, and find a major cause is the inaccurate classification of object proposals.
no code implementations • 23 Oct 2019 • Michael Diodato, Yu Li, Manik Goyal, Iddo Drori
Autonomous driving has a significant impact on society.
1 code implementation • EACL 2021 • Qingyang Wu, Yichi Zhang, Yu Li, Zhou Yu
Existing dialog system models require extensive human annotations and are difficult to generalize to different tasks.
1 code implementation • Remote Sensing of Environment 2019 • Marc Wieland, Yu Li, Sandro Martinis
The rule-based Fmask method takes significantly longer (277. 8 s/megapixel) and produces results with an accuracy of 0. 75, Kappa of 0. 60 and Dice coefficient of 0. 72.
3 code implementations • 2 Aug 2019 • Feifan Lv, Yu Li, Feng Lu
Low-light image enhancement is challenging in that it needs to consider not only brightness recovery but also complex issues like color distortion and noise, which usually hide in the dark.
Ranked #1 on
Low-Light Image Enhancement
on 3DMatch Benchmark
(using extra training data)
1 code implementation • 27 Jul 2019 • Yunfei Liu, Yu Li, ShaoDi You, Feng Lu
Reflection is common in images capturing scenes behind a glass window, which is not only a disturbance visually but also influence the performance of other computer vision algorithms.
no code implementations • 24 Jul 2019 • Shaodi You, Erqi Huang, Shuaizhe Liang, Yongrong Zheng, Yunxiang Li, Fan Wang, Sen Lin, Qiu Shen, Xun Cao, Diming Zhang, Yuanjiang Li, Yu Li, Ying Fu, Boxin Shi, Feng Lu, Yinqiang Zheng, Robby T. Tan
This document introduces the background and the usage of the Hyperspectral City Dataset and the benchmark.
no code implementations • 27 May 2019 • Ye Tian, Li Yang, Wei Wang, Jing Zhang, Qing Tang, Mili Ji, Yang Yu, Yu Li, Hong Yang, Airong Qian
Traditionally, the most indispensable diagnosis of cervix squamous carcinoma is histopathological assessment which is achieved under microscope by pathologist.
no code implementations • 8 Apr 2019 • Yu Li, Hu Wang, Wenquan Shuai, Honghao Zhang, Yong Peng
Therefore, in this study, an improved ReConNN method is proposed to address the mentioned weaknesses.
1 code implementation • 28 Feb 2019 • Yu Li, Chao Huang, Lizhong Ding, Zhongxiao Li, Yijie Pan, Xin Gao
Deep learning, which is especially formidable in handling big data, has achieved great success in various fields, including bioinformatics.
no code implementations • 6 Dec 2018 • Bo Luo, Min Li, Yu Li, Qiang Xu
Machine learning systems based on deep neural networks (DNNs) have gained mainstream adoption in many applications.
no code implementations • 9 Nov 2018 • Qiming Zou, Ling Wang, Ke Lu, Yu Li
Direct policy search is one of the most important algorithm of reinforcement learning.
2 code implementations • 7 Nov 2018 • Rui Zhang, Sheng Tang, Yu Li, Junbo Guo, Yongdong Zhang, Jintao Li, Shuicheng Yan
The S3-GAN consists of an encoder network, a generator network, and an adversarial network.
no code implementations • 6 Nov 2018 • Yu Li, Hu Wang, Xinjian Deng
Therefore, an image-based reconstruction model of a heat transfer process for a 3D-PFHS is established.
4 code implementations • 16 Oct 2018 • Yu Li, Richard Mikael Slevinsky
We present a unified treatment of the Fourier spectra of spherically symmetric nonlocal diffusion operators.
Numerical Analysis 33C20, 41A20
no code implementations • 2 Oct 2018 • Ramzan Umarov, Hiroyuki Kuwahara, Yu Li, Xin Gao, Victor Solovyev
In this work we further develop our deep learning approach that was relatively successful to discriminate short promoter and non-promoter sequences.
no code implementations • 3 Sep 2018 • Zhixiang Hao, Yu Li, ShaoDi You, Feng Lu
However, depth estimation is a dense prediction problem and low-resolution feature maps usually generate blurred depth map which is undesirable in application.
1 code implementation • 16 Aug 2018 • Yu Li, Lizhong Ding, Xin Gao
We demonstrate, both theoretically and empirically, that the last weight layer of a neural network converges to a linear SVM trained on the output of the last hidden layer, for both the binary case and the multi-class case with the commonly used cross-entropy loss.
no code implementations • 29 Jul 2018 • Chu-min Li, Fan Xiao, Mao Luo, Felip Manyà, Zhipeng Lü, Yu Li
Original and learnt clauses in Conflict-Driven Clause Learning (CDCL) SAT solvers often contain redundant literals.
1 code implementation • 8 Jun 2018 • Yu Li, Zhongxiao Li, Lizhong Ding, Yijie Pan, Chao Huang, Yuhui Hu, Wei Chen, Xin Gao
A plain well-trained deep learning model often does not have the ability to learn new knowledge without forgetting the previously learned knowledge, which is known as catastrophic forgetting.
no code implementations • 29 May 2018 • Yu Li, Ya zhang
Web page saliency prediction is a challenge problem in image transformation and computer vision.
1 code implementation • 20 May 2018 • Yu Li, Fan Xu, Fa Zhang, Pingyong Xu, Mingshu Zhang, Ming Fan, Lihua Li, Xin Gao, Renmin Han
Our method combines the strength of deep learning and statistical inference, where deep learning captures the underlying distribution of the fluorophores that are consistent with the observed time-series fluorescent images by exploring local features and correlation along time-axis, and statistical inference further refines the ultrastructure extracted by deep learning and endues physical meaning to the final image.
no code implementations • 19 Apr 2018 • Yu Li, Hu Wang, Kangjia Mo, Tao Zeng
In such a framework, a reconstruction neural network (ReConNN) model designed for simulation-based physical field's reconstruction is proposed.
no code implementations • 5 Mar 2018 • Lingxiao Wei, Bo Luo, Yu Li, Yannan Liu, Qiang Xu
Deep learning has become the de-facto computational paradigm for various kinds of perception problems, including many privacy-sensitive applications such as online medical image analysis.
no code implementations • 15 Nov 2017 • Yu Li, Hu Wang, Juanjuan Liu
In order to evaluate the proposed CNN metamodel for hundreds-dimensional and strong nonlinear problems, CNN is compared with other metamodeling techniques.
2 code implementations • IEEE TIP 2016 • Xiaojie Guo, Yu Li, Haibin Ling
When one captures images in low-light conditions, the images often suffer from low visibility.
Ranked #1 on
Low-Light Image Enhancement
on 10 Monkey Species
(using extra training data)
no code implementations • 21 Jul 2016 • Yu Li, ShaoDi You, Michael S. Brown, Robby T. Tan
This paper provides a comprehensive survey of methods dealing with visibility enhancement of images taken in hazy or foggy scenes.
no code implementations • CVPR 2016 • Yu Li, Robby T. Tan, Xiaojie Guo, Jiangbo Lu, Michael S. Brown
This paper addresses the problem of rain streak removal from a single image.
no code implementations • ICCV 2015 • Yu Li, Robby T. Tan, Michael S. Brown
We demonstrate the effectiveness of our nighttime haze model and correction method on a number of examples and compare our results with existing daytime and nighttime dehazing methods' results.
no code implementations • ICCV 2015 • Yu Li, Dongbo Min, Michael S. Brown, Minh N. Do, Jiangbo Lu
However, the quality of the PMBP solution is tightly coupled with the local window size, over which the raw data cost is aggregated to mitigate ambiguity in the data constraint.
no code implementations • CVPR 2014 • Yu Li, Michael S. Brown
This problem arises most notably in intrinsic image decomposition and reflection interference removal.