Search Results for author: Lei Ding

Found 25 papers, 13 papers with code

Right this way: Can VLMs Guide Us to See More to Answer Questions?

1 code implementation1 Nov 2024 Li Liu, Diji Yang, Sijia Zhong, Kalyana Suma Sree Tholeti, Lei Ding, Yi Zhang, Leilani H. Gilpin

To investigate this gap, we identify a critical and challenging task in the Visual Question Answering (VQA) scenario: can VLMs indicate how to adjust an image when the visual information is insufficient to answer a question?

Question Answering Visual Question Answering

Dual-Model Distillation for Efficient Action Classification with Hybrid Edge-Cloud Solution

no code implementations16 Oct 2024 Timothy Wei, Hsien Xin Peng, Elaine Xu, Bryan Zhao, Lei Ding, Diji Yang

As Artificial Intelligence models, such as Large Video-Language models (VLMs), grow in size, their deployment in real-world applications becomes increasingly challenging due to hardware limitations and computational costs.

Action Classification

SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training

no code implementations9 Jul 2024 Nan He, Weichen Xiong, Hanwen Liu, Yi Liao, Lei Ding, Kai Zhang, Guohua Tang, Xiao Han, Wei Yang

The effectiveness of large language models (LLMs) is often hindered by duplicated data in their extensive pre-training datasets.

Language Modelling

Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding

1 code implementation27 Jun 2024 Yue Fan, Lei Ding, Ching-Chen Kuo, Shan Jiang, Yang Zhao, Xinze Guan, Jie Yang, Yi Zhang, Xin Eric Wang

Based on the tree, our ToL agent not only comprehends the content of the indicated area but also articulates the layout and spatial relationships between elements.

Enhancing Mobile "How-to" Queries with Automated Search Results Verification and Reranking

1 code implementation13 Apr 2024 Lei Ding, Jeshwanth Bheemanpally, Yi Zhang

This paper introduces a novel approach to improving the accuracy and relevance of online technical support search results through automated search results verification and reranking.

AI Agent

A Survey on Human-AI Teaming with Large Pre-Trained Models

no code implementations7 Mar 2024 Vanshika Vats, Marzia Binta Nizam, Minghao Liu, Ziyuan Wang, Richard Ho, Mohnish Sai Prasad, Vincent Titterton, Sai Venkat Malreddy, Riya Aggarwal, Yanwen Xu, Lei Ding, Jay Mehta, Nathan Grinnell, Li Liu, Sijia Zhong, Devanathan Nallur Gandamani, Xinyi Tang, Rohan Ghosalkar, Celeste Shen, Rachel Shen, Nafisa Hussain, Kesav Ravichandran, James Davis

In the rapidly evolving landscape of artificial intelligence (AI), the collaboration between human intelligence and AI systems, known as Human-AI (HAI) Teaming, has emerged as a cornerstone for advancing problem-solving and decision-making processes.

Decision Making

Gaussian Differential Privacy on Riemannian Manifolds

1 code implementation NeurIPS 2023 Yangdi Jiang, Xiaotian Chang, Yi Liu, Lei Ding, Linglong Kong, Bei Jiang

We develop an advanced approach for extending Gaussian Differential Privacy (GDP) to general Riemannian manifolds.

Temporal compressive edge imaging enabled by a lensless diffuser camera

no code implementations13 Sep 2023 Ze Zheng, Baolei Liu, Jiaqi Song, Lei Ding, Xiaolan Zhong, David Mcgloin, Fan Wang

Lensless imagers based on diffusers or encoding masks enable high-dimensional imaging from a single shot measurement and have been applied in various applications.

Edge Detection

Adapting Segment Anything Model for Change Detection in HR Remote Sensing Images

1 code implementation4 Sep 2023 Lei Ding, Kun Zhu, Daifeng Peng, Hao Tang, Kuiwu Yang, Lorenzo Bruzzone

In this work, we aim to utilize the strong visual recognition capabilities of VFMs to improve the change detection of high-resolution Remote Sensing Images (RSIs).

Change Detection Interactive Segmentation

Joint Spatio-Temporal Modeling for the Semantic Change Detection in Remote Sensing Images

3 code implementations10 Dec 2022 Lei Ding, Jing Zhang, Kai Zhang, Haitao Guo, Bing Liu, Lorenzo Bruzzone

Semantic Change Detection (SCD) refers to the task of simultaneously extracting the changed areas and the semantic categories (before and after the changes) in Remote Sensing Images (RSIs).

Change Detection

Deep Unsupervised Key Frame Extraction for Efficient Video Classification

no code implementations12 Nov 2022 Hao Tang, Lei Ding, Songsong Wu, Bin Ren, Nicu Sebe, Paolo Rota

The proposed TSDPC is a generic and powerful framework and it has two advantages compared with previous works, one is that it can calculate the number of key frames automatically.

Classification Video Classification

Conformalized Fairness via Quantile Regression

1 code implementation5 Oct 2022 Meichen Liu, Lei Ding, Dengdeng Yu, Wulong Liu, Linglong Kong, Bei Jiang

To fulfill great needs and advocate the significance of quantile fairness, we propose a novel framework to learn a real-valued quantile function under the fairness requirement of Demographic Parity with respect to sensitive attributes, such as race or gender, and thereby derive a reliable fair prediction interval.

Conformal Prediction Fairness +2

AMCAD: Adaptive Mixed-Curvature Representation based Advertisement Retrieval System

no code implementations28 Mar 2022 Zhirong Xu, Shiyang Wen, Junshan Wang, Guojun Liu, Liang Wang, Zhi Yang, Lei Ding, Yan Zhang, Di Zhang, Jian Xu, Bo Zheng

Moreover, to deploy AMCAD in Taobao, one of the largest ecommerce platforms with hundreds of million users, we design an efficient two-layer online retrieval framework for the task of graph based advertisement retrieval.

Graph Embedding Information Retrieval +1

Word Embeddings via Causal Inference: Gender Bias Reducing and Semantic Information Preserving

1 code implementation9 Dec 2021 Lei Ding, Dengdeng Yu, Jinhan Xie, Wenxing Guo, Shenggang Hu, Meichen Liu, Linglong Kong, Hongsheng Dai, Yanchun Bao, Bei Jiang

The proposed method allows us to construct and analyze the complex causal mechanisms facilitating gender information flow while retaining oracle semantic information within word embeddings.

Causal Inference Word Embeddings +1

Bi-Temporal Semantic Reasoning for the Semantic Change Detection in HR Remote Sensing Images

1 code implementation13 Aug 2021 Lei Ding, Haitao Guo, Sicong Liu, Lichao Mou, Jing Zhang, Lorenzo Bruzzone

Recent studies indicate that the SCD can be modeled through a triple-branch Convolutional Neural Network (CNN), which contains two temporal branches and a change branch.

Change Detection

Field-tunable toroidal moment in a chiral-lattice magnet

no code implementations1 Mar 2021 Lei Ding, Xianghan Xu, Harald O. Jeschke, Xiaojian Bai, Erxi Feng, Admasu Solomon Alemayehu, Jaewook Kim, Feiting Huang, Qiang Zhang, Xiaxin Ding, Neil Harrison, Vivien Zapf, Daniel Khomskii, Igor I. Mazin, Sang-Wook Cheong, Huibo Cao

A toroidal dipole moment appears independent of the electric and magnetic dipole moment in the multipole expansion of electrodynamics.

Strongly Correlated Electrons Materials Science

Adversarial Shape Learning for Building Extraction in VHR Remote Sensing Images

1 code implementation22 Feb 2021 Lei Ding, Hao Tang, Yahui Liu, Yilei Shi, Xiao Xiang Zhu, Lorenzo Bruzzone

To address this issue, we propose an adversarial shape learning network (ASLNet) to model the building shape patterns that improve the accuracy of building segmentation.

Segmentation

Defending against GAN-based Deepfake Attacks via Transformation-aware Adversarial Faces

no code implementations12 Jun 2020 Chaofei Yang, Lei Ding, Yiran Chen, Hai Li

On the one hand, the quality of the synthesized faces is reduced with more visual artifacts such that the synthesized faces are more obviously fake or less convincing to human observers.

Face Swapping

DiResNet: Direction-aware Residual Network for Road Extraction in VHR Remote Sensing Images

1 code implementation14 May 2020 Lei Ding, Lorenzo Bruzzone

The binary segmentation of roads in very high resolution (VHR) remote sensing images (RSIs) has always been a challenging task due to factors such as occlusions (caused by shadows, trees, buildings, etc.)

Segmentation

Reducing Selection Bias in Counterfactual Reasoning for Individual Treatment Effects Estimation

no code implementations19 Dec 2019 Zichen Zhang, Qingfeng Lan, Lei Ding, Yue Wang, Negar Hassanpour, Russell Greiner

We learn two groups of latent random variables, where one group corresponds to variables that only cause selection bias, and the other group is relevant for outcome prediction.

counterfactual Counterfactual Reasoning +1

Improving Semantic Segmentation of Aerial Images Using Patch-based Attention

no code implementations20 Nov 2019 Lei Ding, Hao Tang, Lorenzo Bruzzone

High-level features extracted from the late layers of a neural network are rich in semantic information, yet have blurred spatial details; low-level features extracted from the early layers of a network contain more pixel-level information, but are isolated and noisy.

Semantic Segmentation

Cannot find the paper you are looking for? You can Submit a new open access paper.