Search Results for author: Qianli Ma

Found 40 papers, 20 papers with code

CATE: A Contrastive Pre-trained Model for Metaphor Detection with Semi-supervised Learning

no code implementations EMNLP 2021 Zhenxi Lin, Qianli Ma, Jiangyue Yan, Jieyu Chen

Metaphors are ubiquitous in natural language, and detecting them requires contextual reasoning about whether a semantic incongruence actually exists.

Self-Adaptive Reconstruction with Contrastive Learning for Unsupervised Sentence Embeddings

no code implementations23 Feb 2024 Junlong Liu, Xichen Shang, Huawen Feng, Junhao Zheng, Qianli Ma

However, due to the token bias in pretrained language models, the models can not capture the fine-grained semantics in sentences, which leads to poor predictions.

Contrastive Learning Sentence +2

Conditional Logical Message Passing Transformer for Complex Query Answering

no code implementations20 Feb 2024 Chongzhi Zhang, Zhiping Peng, Junhao Zheng, Qianli Ma

In this paper, we propose Conditional Logical Message Passing Transformer (CLMPT), which considers the difference between constants and variables in the case of using pre-trained neural link predictors and performs message passing conditionally on the node type.

Complex Query Answering Logical Reasoning

Incremental Sequence Labeling: A Tale of Two Shifts

no code implementations16 Feb 2024 Shengjie Qiu, Junhao Zheng, Zhen Liu, Yicheng Luo, Qianli Ma

As for the E2O problem, we use knowledge distillation to maintain the model's discriminative ability for old entities.

Knowledge Distillation

Balancing the Causal Effects in Class-Incremental Learning

no code implementations15 Feb 2024 Junhao Zheng, Ruiyan Wang, Chongzhi Zhang, Huawen Feng, Qianli Ma

In this way, the model is encouraged to adapt to all classes with causal effects from both new and old data and thus alleviates the causal imbalance problem.

Class Incremental Learning Continual Named Entity Recognition +6

Concept-1K: A Novel Benchmark for Instance Incremental Learning

1 code implementation13 Feb 2024 Junhao Zheng, Shengjie Qiu, Qianli Ma

However, existing IL scenarios and datasets are unqualified for assessing forgetting in PLMs, giving an illusion that PLMs do not suffer from catastrophic forgetting.

Incremental Learning

Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer

no code implementations17 Jan 2024 Junhao Zheng, Qianli Ma, Zhen Liu, Binquan Wu, Huawen Feng

The discrepancy results in the model learning irrelevant information for old and pre-trained tasks, which leads to catastrophic forgetting and negative forward transfer.

InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks

1 code implementation10 Jan 2024 Xueyu Hu, Ziyu Zhao, Shuang Wei, Ziwei Chai, Qianli Ma, Guoyin Wang, Xuwu Wang, Jing Su, Jingjing Xu, Ming Zhu, Yao Cheng, Jianbo Yuan, Jiwei Li, Kun Kuang, Yang Yang, Hongxia Yang, Fei Wu

In this paper, we introduce InfiAgent-DABench, the first benchmark specifically designed to evaluate LLM-based agents on data analysis tasks.

Benchmarking

Learn or Recall? Revisiting Incremental Learning with Pre-trained Language Models

1 code implementation13 Dec 2023 Junhao Zheng, Shengjie Qiu, Qianli Ma

Most assume that catastrophic forgetting is the biggest obstacle to achieving superior IL performance and propose various techniques to overcome this issue.

Class Incremental Learning Incremental Learning +7

Improving Factual Consistency of Text Summarization by Adversarially Decoupling Comprehension and Embellishment Abilities of LLMs

no code implementations30 Oct 2023 Huawen Feng, Yan Fan, Xiong Liu, Ting-En Lin, Zekun Yao, Yuchuan Wu, Fei Huang, Yongbin Li, Qianli Ma

Despite the recent progress in text summarization made by large language models (LLMs), they often generate summaries that are factually inconsistent with original articles, known as "hallucinations" in text generation.

Text Generation Text Summarization

LoBaSS: Gauging Learnability in Supervised Fine-tuning Data

no code implementations16 Oct 2023 Haotian Zhou, Tingkai Liu, Qianli Ma, Jianbo Yuan, PengFei Liu, Yang You, Hongxia Yang

In this paper, we introduce a new dimension in SFT data selection: learnability.

Neural Operator Variational Inference based on Regularized Stein Discrepancy for Deep Gaussian Processes

no code implementations22 Sep 2023 Jian Xu, Shian Du, Junmei Yang, Qianli Ma, Delu Zeng

Furthermore, our method guarantees theoretically controlled prediction error for DGP models and demonstrates remarkable performance on various datasets.

Bayesian Inference Gaussian Processes +2

Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference

1 code implementation19 Jun 2023 Junhao Zheng, Qianli Ma, Shengjie Qiu, Yue Wu, Peitian Ma, Junlong Liu, Huawen Feng, Xichen Shang, Haibin Chen

Intriguingly, the unified objective can be seen as the sum of the vanilla fine-tuning objective, which learns new knowledge from target data, and the causal objective, which preserves old knowledge from PLMs.

Attribute Causal Inference

Perturbation-based Self-supervised Attention for Attention Bias in Text Classification

no code implementations25 May 2023 Huawen Feng, Zhenxi Lin, Qianli Ma

In text classification, the traditional attention mechanisms usually focus too much on frequent words, and need extensive labeled data in order to learn.

Sentence text-classification +1

A Survey on Time-Series Pre-Trained Models

1 code implementation18 May 2023 Qianli Ma, Zhen Liu, Zhenjing Zheng, Ziyang Huang, Siying Zhu, Zhongzhong Yu, James T. Kwok

Time-Series Mining (TSM) is an important research area since it shows great potential in practical applications.

Time Series Transfer Learning

Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Views

1 code implementation ICCV 2023 Siwei Zhang, Qianli Ma, Yan Zhang, Sadegh Aliakbarian, Darren Cosker, Siyu Tang

One of the biggest challenges of this task is severe body truncation due to close social distances in egocentric scenarios, which brings large pose ambiguities for unseen body parts.

Human Mesh Recovery

Dynamic Point Fields

no code implementations ICCV 2023 Sergey Prokudin, Qianli Ma, Maxime Raafat, Julien Valentin, Siyu Tang

In this work, we present a dynamic point field model that combines the representational benefits of explicit point-based graphics with implicit deformation networks to allow efficient modeling of non-rigid 3D surfaces.

Surface Reconstruction

Pair-Based Joint Encoding with Relational Graph Convolutional Networks for Emotion-Cause Pair Extraction

1 code implementation4 Dec 2022 Junlong Liu, Xichen Shang, Qianli Ma

Emotion-cause pair extraction (ECPE) aims to extract emotion clauses and corresponding cause clauses, which have recently received growing attention.

Emotion-Cause Pair Extraction

Distilling Causal Effect from Miscellaneous Other-Class for Continual Named Entity Recognition

1 code implementation8 Oct 2022 Junhao Zheng, Zhanxian Liang, Haibin Chen, Qianli Ma

Thanks to the causal inference, we identify that the forgetting is caused by the missing causal effect from the old data.

Causal Inference FG-1-PG-1 +4

Neural Point-based Shape Modeling of Humans in Challenging Clothing

no code implementations14 Sep 2022 Qianli Ma, Jinlong Yang, Michael J. Black, Siyu Tang

Specifically, we extend point-based methods with a coarse stage, that replaces canonicalization with a learned pose-independent "coarse shape" that can capture the rough surface geometry of clothing like skirts.

EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devices

1 code implementation14 Dec 2021 Siwei Zhang, Qianli Ma, Yan Zhang, Zhiyin Qian, Taein Kwon, Marc Pollefeys, Federica Bogo, Siyu Tang

Key to reasoning about interactions is to understand the body pose and motion of the interaction partner from the egocentric view.

Motion Estimation

The Power of Points for Modeling Humans in Clothing

no code implementations ICCV 2021 Qianli Ma, Jinlong Yang, Siyu Tang, Michael J. Black

The geometry feature can be optimized to fit a previously unseen scan of a person in clothing, enabling the scan to be reposed realistically.

Hierarchy-aware Label Semantics Matching Network for Hierarchical Text Classification

1 code implementation ACL 2021 Haibin Chen, Qianli Ma, Zhenxi Lin, Jiangyue Yan

We then introduce a joint embedding loss and a matching learning loss to model the matching relationship between the text semantics and the label semantics.

text-classification Text Classification

A Span-based Dynamic Local Attention Model for Sequential Sentence Classification

no code implementations ACL 2021 Xichen Shang, Qianli Ma, Zhenxi Lin, Jiangyue Yan, Zipeng Chen

Sequential sentence classification aims to classify each sentence in the document based on the context in which sentences appear.

Classification Sentence +1

MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images

1 code implementation NeurIPS 2021 Shaofei Wang, Marko Mihajlovic, Qianli Ma, Andreas Geiger, Siyu Tang

In contrast, we propose an approach that can quickly generate realistic clothed human avatars, represented as controllable neural SDFs, given only monocular depth images.

Meta-Learning

Embedding-based Product Retrieval in Taobao Search

no code implementations17 Jun 2021 Sen Li, Fuyu Lv, Taiwei Jin, Guli Lin, Keping Yang, Xiaoyi Zeng, Xiao-Ming Wu, Qianli Ma

We evaluate MGDSPR on Taobao Product Search with significant metrics gains observed in offline experiments and online A/B tests.

Open-Ended Question Answering Retrieval

Learning Representations for Incomplete Time Series Clustering

1 code implementation AAAI 2021 Qianli Ma, Chuxin Chen, Sen Li, Garrison W. Cottrell

Also, to reduce the error propagation from imputation to clustering, we introduce a discriminator to make the distribution of imputation values close to the true one and train CRLI in an alternating train- ing manner.

Clustering Imputation +3

SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networks

2 code implementations CVPR 2021 Shunsuke Saito, Jinlong Yang, Qianli Ma, Michael J. Black

We present SCANimate, an end-to-end trainable framework that takes raw 3D scans of a clothed human and turns them into an animatable avatar.

Weakly-supervised Learning

PLACE: Proximity Learning of Articulation and Contact in 3D Environments

1 code implementation12 Aug 2020 Siwei Zhang, Yan Zhang, Qianli Ma, Michael J. Black, Siyu Tang

To synthesize realistic human-scene interactions, it is essential to effectively represent the physical contact and proximity between the body and the world.

Learning Representations for Time Series Clustering

2 code implementations NeurIPS 2019 Qianli Ma, Jiawei Zheng, Sen Li, Gary W. Cottrell

When applying seq2seq to time series clustering, obtaining a representation that effectively represents the temporal dynamics of the sequence, multi-scale features, and good clustering properties remains a challenge.

Anomaly Detection Clustering +4

Frontal Low-rank Random Tensors for Fine-grained Action Segmentation

1 code implementation3 Jun 2019 Yan Zhang, Krikamol Muandet, Qianli Ma, Heiko Neumann, Siyu Tang

In this paper, we propose an approach to representing high-order information for temporal action segmentation via a simple yet effective bilinear form.

Action Parsing Action Segmentation +1

Classification of lung nodules in CT images based on Wasserstein distance in differential geometry

no code implementations30 Jun 2018 Min Zhang, Qianli Ma, Chengfeng Wen, Hai Chen, Deruo Liu, Xianfeng GU, Jie He, Xiaoyin Xu

The Wasserstein distance between the nodules is calculated based on our new spherical optimal mass transport, this new algorithm works directly on sphere by using spherical metric, which is much more accurate and efficient than previous methods.

Computed Tomography (CT) General Classification +2

Deep-ESN: A Multiple Projection-encoding Hierarchical Reservoir Computing Framework

no code implementations13 Nov 2017 Qianli Ma, Lifeng Shen, Garrison W. Cottrell

As an efficient recurrent neural network (RNN) model, reservoir computing (RC) models, such as Echo State Networks, have attracted widespread attention in the last decade.

Time Series Time Series Analysis

Theano: A Python framework for fast computation of mathematical expressions

1 code implementation9 May 2016 The Theano Development Team, Rami Al-Rfou, Guillaume Alain, Amjad Almahairi, Christof Angermueller, Dzmitry Bahdanau, Nicolas Ballas, Frédéric Bastien, Justin Bayer, Anatoly Belikov, Alexander Belopolsky, Yoshua Bengio, Arnaud Bergeron, James Bergstra, Valentin Bisson, Josh Bleecher Snyder, Nicolas Bouchard, Nicolas Boulanger-Lewandowski, Xavier Bouthillier, Alexandre de Brébisson, Olivier Breuleux, Pierre-Luc Carrier, Kyunghyun Cho, Jan Chorowski, Paul Christiano, Tim Cooijmans, Marc-Alexandre Côté, Myriam Côté, Aaron Courville, Yann N. Dauphin, Olivier Delalleau, Julien Demouth, Guillaume Desjardins, Sander Dieleman, Laurent Dinh, Mélanie Ducoffe, Vincent Dumoulin, Samira Ebrahimi Kahou, Dumitru Erhan, Ziye Fan, Orhan Firat, Mathieu Germain, Xavier Glorot, Ian Goodfellow, Matt Graham, Caglar Gulcehre, Philippe Hamel, Iban Harlouchet, Jean-Philippe Heng, Balázs Hidasi, Sina Honari, Arjun Jain, Sébastien Jean, Kai Jia, Mikhail Korobov, Vivek Kulkarni, Alex Lamb, Pascal Lamblin, Eric Larsen, César Laurent, Sean Lee, Simon Lefrancois, Simon Lemieux, Nicholas Léonard, Zhouhan Lin, Jesse A. Livezey, Cory Lorenz, Jeremiah Lowin, Qianli Ma, Pierre-Antoine Manzagol, Olivier Mastropietro, Robert T. McGibbon, Roland Memisevic, Bart van Merriënboer, Vincent Michalski, Mehdi Mirza, Alberto Orlandi, Christopher Pal, Razvan Pascanu, Mohammad Pezeshki, Colin Raffel, Daniel Renshaw, Matthew Rocklin, Adriana Romero, Markus Roth, Peter Sadowski, John Salvatier, François Savard, Jan Schlüter, John Schulman, Gabriel Schwartz, Iulian Vlad Serban, Dmitriy Serdyuk, Samira Shabanian, Étienne Simon, Sigurd Spieckermann, S. Ramana Subramanyam, Jakub Sygnowski, Jérémie Tanguay, Gijs van Tulder, Joseph Turian, Sebastian Urban, Pascal Vincent, Francesco Visin, Harm de Vries, David Warde-Farley, Dustin J. Webb, Matthew Willson, Kelvin Xu, Lijun Xue, Li Yao, Saizheng Zhang, Ying Zhang

Since its introduction, it has been one of the most used CPU and GPU mathematical compilers - especially in the machine learning community - and has shown steady performance improvements.

BIG-bench Machine Learning Clustering +2

Cannot find the paper you are looking for? You can Submit a new open access paper.