Search Results for author: Lei Yu

Found 113 papers, 44 papers with code

Dynamic Activation Pitfalls in LLaMA Models: An Empirical Study

no code implementations15 May 2024 Chi Ma, Mincong Huang, Chao Wang, Yujie Wang, Lei Yu

In this work, we systematically investigate the efficacy of dynamic activation mechanisms within the LLaMA family of language models.


Super-Resolving Blurry Images with Events

no code implementations11 May 2024 Chi Zhang, Mingyuan Lin, Xiang Zhang, Chenxu Jiang, Lei Yu

Super-resolution from motion-blurred images poses a significant challenge due to the combined effects of motion blur and low spatial resolution.


Learning Monocular Depth from Focus with Event Focal Stack

no code implementations11 May 2024 Chenxu Jiang, Mingyuan Lin, Chi Zhang, Zhenghai Wang, Lei Yu

Depth from Focus estimates depth by determining the moment of maximum focus from multiple shots at different focal distances, i. e. the Focal Stack.

Non-Uniform Exposure Imaging via Neuromorphic Shutter Control

no code implementations22 Apr 2024 Mingyuan Lin, Jian Liu, Chi Zhang, Zibo Zhao, Chu He, Lei Yu

To address this challenge, we propose a novel Neuromorphic Shutter Control (NSC) system to avoid motion blurs and alleviate instant noises, where the extremely low latency of events is leveraged to monitor the real-time motion and facilitate the scene-adaptive exposure.

Image Denoising Self-Supervised Learning

MTGA: Multi-view Temporal Granularity aligned Aggregation for Event-based Lip-reading

no code implementations18 Apr 2024 WenHao Zhang, Jun Wang, Yong Luo, Lei Yu, Wei Yu, Zheng He

Then we design a spatio-temporal fusion module based on temporal granularity alignment, where the global spatial features extracted from event frames, together with the local relative spatial and temporal features contained in voxel graph list are effectively aligned and integrated.

Lip Reading

Detecting Every Object from Events

2 code implementations8 Apr 2024 Haitian Zhang, Chang Xu, Xinya Wang, Bingde Liu, Guang Hua, Lei Yu, Wen Yang

Object detection is critical in autonomous driving, and it is more practical yet challenging to localize objects of unknown categories: an endeavour known as Class-Agnostic Object Detection (CAOD).

Autonomous Driving Class-agnostic Object Detection +5

Inclusive Design Insights from a Preliminary Image-Based Conversational Search Systems Evaluation

no code implementations29 Mar 2024 Yue Zheng, Lei Yu, Junmian Chen, Tianyu Xia, Yuanyuan Yin, Shan Wang, Haiming Liu

The digital realm has witnessed the rise of various search modalities, among which the Image-Based Conversational Search System stands out.

Conversational Search Emotion Recognition

Mechanisms of non-factual hallucinations in language models

1 code implementation27 Mar 2024 Lei Yu, Meng Cao, Jackie Chi Kit Cheung, Yue Dong

Our study investigates the mechanistic causes of hallucination, specifically non-factual ones where the LM incorrectly predicts object attributes in response to subject-relation queries.

Attribute Hallucination +2

Using construction waste hauling trucks' GPS data to classify earthwork-related locations: A Chengdu case study

no code implementations22 Feb 2024 Lei Yu, Ke Han

Earthwork-related locations (ERLs), such as construction sites, earth dumping ground, and concrete mixing stations, are major sources of urban dust pollution (particulate matters).


An LLM Maturity Model for Reliable and Transparent Text-to-Query

no code implementations20 Feb 2024 Lei Yu, Abir Ray

Recognizing the imperative to address the reliability and transparency issues of Large Language Models (LLM), this work proposes an LLM maturity model tailored for text-to-query applications.

Neuromorphic Synergy for Video Binarization

1 code implementation20 Feb 2024 ShiJie Lin, Xiang Zhang, Lei Yang, Lei Yu, Bin Zhou, Xiaowei Luo, Wenping Wang, Jia Pan

We also develop an efficient integration method to propagate this binary image to high frame rate binary video.

Binarization Camera Calibration +1

A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspective

no code implementations6 Feb 2024 Lei Yu, Meng Han, Yiming Li, Changting Lin, Yao Zhang, Mingyang Zhang, Yan Liu, Haiqin Weng, Yuseok Jeon, Ka-Ho Chow, Stacy Patterson

Vertical Federated Learning (VFL) is a federated learning paradigm where multiple participants, who share the same set of samples but hold different features, jointly train machine learning models.

Vertical Federated Learning

Beyond Sparse Rewards: Enhancing Reinforcement Learning with Language Model Critique in Text Generation

no code implementations14 Jan 2024 Meng Cao, Lei Shu, Lei Yu, Yun Zhu, Nevan Wichers, Yinxiao Liu, Lei Meng

We investigate this approach under two different settings: one where the policy model is smaller and is paired with a more powerful critic model, and another where a single language model fulfills both roles.

Language Modelling reinforcement-learning +2

Re-evaluating the Memory-balanced Pipeline Parallelism: BPipe

no code implementations4 Jan 2024 Mincong Huang, Chao Wang, Chi Ma, Yineng Zhang, Peng Zhang, Lei Yu

Pipeline parallelism is an essential technique in the training of large-scale Transformer models.

Imperio: Language-Guided Backdoor Attacks for Arbitrary Model Control

no code implementations2 Jan 2024 Ka-Ho Chow, Wenqi Wei, Lei Yu

This paper proposes Imperio, which harnesses the language understanding capabilities of NLP models to enrich backdoor attacks.

Backdoor Attack Image Classification +1

RoleCraft-GLM: Advancing Personalized Role-Playing in Large Language Models

1 code implementation17 Dec 2023 Meiling Tao, Xuechen Liang, Tianyu Shi, Lei Yu, Yiting Xie

This study presents RoleCraft-GLM, an innovative framework aimed at enhancing personalized role-playing with Large Language Models (LLMs).

Language Modelling

Systematic word meta-sense extension

1 code implementation21 Nov 2023 Lei Yu

The meaning of polysemous words often varies in a highly productive yet predictable way.

Language Modelling

CrossZoom: Simultaneously Motion Deblurring and Event Super-Resolving

1 code implementation29 Sep 2023 Chi Zhang, Xiang Zhang, Mingyuan Lin, Cheng Li, Chu He, Wen Yang, Gui-Song Xia, Lei Yu

Even though the collaboration between traditional and neuromorphic event cameras brings prosperity to frame-event based vision applications, the performance is still confined by the resolution gap crossing two modalities in both spatial and temporal domains.

Deblurring Event-based vision

Learning Parallax for Stereo Event-based Motion Deblurring

no code implementations18 Sep 2023 Mingyuan Lin, Chi Zhang, Chu He, Lei Yu

To tackle this problem, we propose a novel coarse-to-fine framework, named NETwork of Event-based motion Deblurring with STereo event and intensity cameras (St-EDNet), to recover high-quality images directly from the misaligned inputs, consisting of a single blurry image and the concurrent event streams.

Deblurring Stereo Matching

Circle Feature Graphormer: Can Circle Features Stimulate Graph Transformer?

1 code implementation11 Sep 2023 Jingsong Lv, Hongyang Chen, Yao Qi, Lei Yu

Firstly, we define the first circle feature as modified swing for common graph, which comes from bipartite graph.

Link Prediction

LLaMA-Reviewer: Advancing Code Review Automation with Large Language Models through Parameter-Efficient Fine-Tuning

no code implementations22 Aug 2023 Junyi Lu, Lei Yu, Xiaojia Li, Li Yang, Chun Zuo

In response to this research gap, we present LLaMA-Reviewer, an innovative framework that leverages the capabilities of LLaMA, a popular LLM, in the realm of code review.

Video Frame Interpolation with Stereo Event and Intensity Camera

no code implementations17 Jul 2023 Chao Ding, Mingyuan Lin, Haijian Zhang, Jianzhuang Liu, Lei Yu

The stereo event-intensity camera setup is widely applied to leverage the advantages of both event cameras with low latency and intensity cameras that capture accurate brightness and texture information.

Disparity Estimation Optical Flow Estimation +1

Word sense extension

1 code implementation9 Jun 2023 Lei Yu, Yang Xu

Humans often make creative use of words to express novel senses.

Language Modelling Word Sense Disambiguation

"Seeing'' Electric Network Frequency from Events

1 code implementation4 May 2023 Lexuan Xu, Guang Hua, Haijian Zhang, Lei Yu, Ning Qiao

Most of the artificial lights fluctuate in response to the grid's alternating current and exhibit subtle variations in terms of both intensity and spectrum, providing the potential to estimate the Electric Network Frequency (ENF) from conventional frame-based videos.

Dynamic Coarse-to-Fine Learning for Oriented Tiny Object Detection

1 code implementation CVPR 2023 Chang Xu, Jian Ding, Jinwang Wang, Wen Yang, Huai Yu, Lei Yu, Gui-Song Xia

Despite the exploration of adaptive label assignment in recent oriented object detectors, the extreme geometry shape and limited feature of oriented tiny objects still induce severe mismatch and imbalance issues.

object-detection Object Detection +2

Self-Supervised Scene Dynamic Recovery from Rolling Shutter Images and Events

no code implementations14 Apr 2023 Yangguang Wang, Xiang Zhang, Mingyuan Lin, Lei Yu, Boxin Shi, Wen Yang, Gui-Song Xia

Scene Dynamic Recovery (SDR) by inverting distorted Rolling Shutter (RS) images to an undistorted high frame-rate Global Shutter (GS) video is a severely ill-posed problem due to the missing temporal dynamic information in both RS intra-frame scanlines and inter-frame exposures, particularly when prior knowledge about camera/object motions is unavailable.

Self-Supervised Learning

DIPNet: Efficiency Distillation and Iterative Pruning for Image Super-Resolution

no code implementations14 Apr 2023 Lei Yu, Xinpeng Li, Youwei Li, Ting Jiang, Qi Wu, Haoqiang Fan, Shuaicheng Liu

To address this issue, we propose a novel multi-stage lightweight network boosting method, which can enable lightweight networks to achieve outstanding performance.

Image Super-Resolution Network Pruning

Recovering Continuous Scene Dynamics from A Single Blurry Image with Events

no code implementations5 Apr 2023 Zhangyi Cheng, Xiang Zhang, Lei Yu, Jianzhuang Liu, Wen Yang, Gui-Song Xia

This paper aims at demystifying a single motion-blurred image with events and revealing temporally continuous scene dynamics encrypted behind motion blurs.

Image Restoration SSIM

Learning to Super-Resolve Blurry Images with Events

1 code implementation27 Feb 2023 Lei Yu, Bishan Wang, Xiang Zhang, Haijian Zhang, Wen Yang, Jianzhuang Liu, Gui-Song Xia

Super-Resolution from a single motion Blurred image (SRB) is a severely ill-posed problem due to the joint degradation of motion blurs and low spatial resolution.

Sparse Learning Super-Resolution

A Reparameterized Discrete Diffusion Model for Text Generation

1 code implementation11 Feb 2023 Lin Zheng, Jianbo Yuan, Lei Yu, Lingpeng Kong

This work studies discrete diffusion probabilistic models with applications to natural language generation.

Text Generation

A Comparison of Decision Forest Inference Platforms from A Database Perspective

no code implementations9 Feb 2023 Hong Guan, Mahidhar Reddy Dwarampudi, Venkatesh Gunda, Hong Min, Lei Yu, Jia Zou

In addition, the relation-centric representation we proposed significantly improved netsDB's performance in handling large-scale models, while the model reuse optimization we proposed further improved netsDB's performance in handling small-scale datasets.

Fraud Detection Management

High-level semantic feature matters few-shot unsupervised domain adaptation

no code implementations5 Jan 2023 Lei Yu, Wanqi Yang, Shengqi Huang, Lei Wang, Ming Yang

However, the goal of FS-UDA and FSL are relevant yet distinct, since FS-UDA aims to classify the samples in target domain rather than source domain.

Few-Shot Learning Unsupervised Domain Adaptation +1

"Seeing" Electric Network Frequency From Events

1 code implementation CVPR 2023 Lexuan Xu, Guang Hua, Haijian Zhang, Lei Yu, Ning Qiao

Most of the artificial lights fluctuate in response to the grid's alternating current and exhibit subtle variations in terms of both intensity and spectrum, providing the potential to estimate the Electric Network Frequency (ENF) from conventional frame-based videos.

A Natural Bias for Language Generation Models

no code implementations19 Dec 2022 Clara Meister, Wojciech Stokowiec, Tiago Pimentel, Lei Yu, Laura Rimell, Adhiguna Kuncoro

After just a few hundred training updates, a standard probabilistic model for language generation has likely not yet learnt many semantic or syntactic rules of natural language, making it difficult to estimate the probability distribution over next tokens.

Machine Translation Text Generation

Learning from Training Dynamics: Identifying Mislabeled Data Beyond Manually Designed Features

1 code implementation19 Dec 2022 Qingrui Jia, Xuhong LI, Lei Yu, Jiang Bian, Penghao Zhao, Shupeng Li, Haoyi Xiong, Dejing Dou

While mislabeled or ambiguously-labeled samples in the training set could negatively affect the performance of deep models, diagnosing the dataset and identifying mislabeled samples helps to improve the generalization power.

Biomedical image analysis competitions: The state of current participation practice

no code implementations16 Dec 2022 Matthias Eisenmann, Annika Reinke, Vivienn Weru, Minu Dietlinde Tizabi, Fabian Isensee, Tim J. Adler, Patrick Godau, Veronika Cheplygina, Michal Kozubek, Sharib Ali, Anubha Gupta, Jan Kybic, Alison Noble, Carlos Ortiz de Solórzano, Samiksha Pachade, Caroline Petitjean, Daniel Sage, Donglai Wei, Elizabeth Wilden, Deepak Alapatt, Vincent Andrearczyk, Ujjwal Baid, Spyridon Bakas, Niranjan Balu, Sophia Bano, Vivek Singh Bawa, Jorge Bernal, Sebastian Bodenstedt, Alessandro Casella, Jinwook Choi, Olivier Commowick, Marie Daum, Adrien Depeursinge, Reuben Dorent, Jan Egger, Hannah Eichhorn, Sandy Engelhardt, Melanie Ganz, Gabriel Girard, Lasse Hansen, Mattias Heinrich, Nicholas Heller, Alessa Hering, Arnaud Huaulmé, Hyunjeong Kim, Bennett Landman, Hongwei Bran Li, Jianning Li, Jun Ma, Anne Martel, Carlos Martín-Isla, Bjoern Menze, Chinedu Innocent Nwoye, Valentin Oreiller, Nicolas Padoy, Sarthak Pati, Kelly Payette, Carole Sudre, Kimberlin Van Wijnen, Armine Vardazaryan, Tom Vercauteren, Martin Wagner, Chuanbo Wang, Moi Hoon Yap, Zeyun Yu, Chun Yuan, Maximilian Zenk, Aneeq Zia, David Zimmerer, Rina Bao, Chanyeol Choi, Andrew Cohen, Oleh Dzyubachyk, Adrian Galdran, Tianyuan Gan, Tianqi Guo, Pradyumna Gupta, Mahmood Haithami, Edward Ho, Ikbeom Jang, Zhili Li, Zhengbo Luo, Filip Lux, Sokratis Makrogiannis, Dominik Müller, Young-tack Oh, Subeen Pang, Constantin Pape, Gorkem Polat, Charlotte Rosalie Reed, Kanghyun Ryu, Tim Scherr, Vajira Thambawita, Haoyu Wang, Xinliang Wang, Kele Xu, Hung Yeh, Doyeob Yeo, Yixuan Yuan, Yan Zeng, Xin Zhao, Julian Abbing, Jannes Adam, Nagesh Adluru, Niklas Agethen, Salman Ahmed, Yasmina Al Khalil, Mireia Alenyà, Esa Alhoniemi, Chengyang An, Talha Anwar, Tewodros Weldebirhan Arega, Netanell Avisdris, Dogu Baran Aydogan, Yingbin Bai, Maria Baldeon Calisto, Berke Doga Basaran, Marcel Beetz, Cheng Bian, Hao Bian, Kevin Blansit, Louise Bloch, Robert Bohnsack, Sara Bosticardo, Jack Breen, Mikael Brudfors, Raphael Brüngel, Mariano Cabezas, Alberto Cacciola, Zhiwei Chen, Yucong Chen, Daniel Tianming Chen, Minjeong Cho, Min-Kook Choi, Chuantao Xie Chuantao Xie, Dana Cobzas, Julien Cohen-Adad, Jorge Corral Acero, Sujit Kumar Das, Marcela de Oliveira, Hanqiu Deng, Guiming Dong, Lars Doorenbos, Cory Efird, Sergio Escalera, Di Fan, Mehdi Fatan Serj, Alexandre Fenneteau, Lucas Fidon, Patryk Filipiak, René Finzel, Nuno R. Freitas, Christoph M. Friedrich, Mitchell Fulton, Finn Gaida, Francesco Galati, Christoforos Galazis, Chang Hee Gan, Zheyao Gao, Shengbo Gao, Matej Gazda, Beerend Gerats, Neil Getty, Adam Gibicar, Ryan Gifford, Sajan Gohil, Maria Grammatikopoulou, Daniel Grzech, Orhun Güley, Timo Günnemann, Chunxu Guo, Sylvain Guy, Heonjin Ha, Luyi Han, Il Song Han, Ali Hatamizadeh, Tian He, Jimin Heo, Sebastian Hitziger, SeulGi Hong, Seungbum Hong, Rian Huang, Ziyan Huang, Markus Huellebrand, Stephan Huschauer, Mustaffa Hussain, Tomoo Inubushi, Ece Isik Polat, Mojtaba Jafaritadi, SeongHun Jeong, Bailiang Jian, Yuanhong Jiang, Zhifan Jiang, Yueming Jin, Smriti Joshi, Abdolrahim Kadkhodamohammadi, Reda Abdellah Kamraoui, Inha Kang, Junghwa Kang, Davood Karimi, April Khademi, Muhammad Irfan Khan, Suleiman A. Khan, Rishab Khantwal, Kwang-Ju Kim, Timothy Kline, Satoshi Kondo, Elina Kontio, Adrian Krenzer, Artem Kroviakov, Hugo Kuijf, Satyadwyoom Kumar, Francesco La Rosa, Abhi Lad, Doohee Lee, Minho Lee, Chiara Lena, Hao Li, Ling Li, Xingyu Li, Fuyuan Liao, Kuanlun Liao, Arlindo Limede Oliveira, Chaonan Lin, Shan Lin, Akis Linardos, Marius George Linguraru, Han Liu, Tao Liu, Di Liu, Yanling Liu, João Lourenço-Silva, Jingpei Lu, Jiangshan Lu, Imanol Luengo, Christina B. Lund, Huan Minh Luu, Yi Lv, Uzay Macar, Leon Maechler, Sina Mansour L., Kenji Marshall, Moona Mazher, Richard McKinley, Alfonso Medela, Felix Meissen, Mingyuan Meng, Dylan Miller, Seyed Hossein Mirjahanmardi, Arnab Mishra, Samir Mitha, Hassan Mohy-ud-Din, Tony Chi Wing Mok, Gowtham Krishnan Murugesan, Enamundram Naga Karthik, Sahil Nalawade, Jakub Nalepa, Mohamed Naser, Ramin Nateghi, Hammad Naveed, Quang-Minh Nguyen, Cuong Nguyen Quoc, Brennan Nichyporuk, Bruno Oliveira, David Owen, Jimut Bahan Pal, Junwen Pan, Wentao Pan, Winnie Pang, Bogyu Park, Vivek Pawar, Kamlesh Pawar, Michael Peven, Lena Philipp, Tomasz Pieciak, Szymon Plotka, Marcel Plutat, Fattaneh Pourakpour, Domen Preložnik, Kumaradevan Punithakumar, Abdul Qayyum, Sandro Queirós, Arman Rahmim, Salar Razavi, Jintao Ren, Mina Rezaei, Jonathan Adam Rico, ZunHyan Rieu, Markus Rink, Johannes Roth, Yusely Ruiz-Gonzalez, Numan Saeed, Anindo Saha, Mostafa Salem, Ricardo Sanchez-Matilla, Kurt Schilling, Wei Shao, Zhiqiang Shen, Ruize Shi, Pengcheng Shi, Daniel Sobotka, Théodore Soulier, Bella Specktor Fadida, Danail Stoyanov, Timothy Sum Hon Mun, Xiaowu Sun, Rong Tao, Franz Thaler, Antoine Théberge, Felix Thielke, Helena Torres, Kareem A. Wahid, Jiacheng Wang, Yifei Wang, Wei Wang, Xiong Wang, Jianhui Wen, Ning Wen, Marek Wodzinski, Ye Wu, Fangfang Xia, Tianqi Xiang, Chen Xiaofei, Lizhan Xu, Tingting Xue, Yuxuan Yang, Lin Yang, Kai Yao, Huifeng Yao, Amirsaeed Yazdani, Michael Yip, Hwanseung Yoo, Fereshteh Yousefirizi, Shunkai Yu, Lei Yu, Jonathan Zamora, Ramy Ashraf Zeineldin, Dewen Zeng, Jianpeng Zhang, Bokai Zhang, Jiapeng Zhang, Fan Zhang, Huahong Zhang, Zhongchen Zhao, Zixuan Zhao, Jiachen Zhao, Can Zhao, Qingshuo Zheng, Yuheng Zhi, Ziqi Zhou, Baosheng Zou, Klaus Maier-Hein, Paul F. Jäger, Annette Kopp-Schneider, Lena Maier-Hein

Of these, 84% were based on standard architectures.


GT-CausIn: a novel causal-based insight for traffic prediction

no code implementations12 Dec 2022 Ting Gao, Rodrigo Kappes Marques, Lei Yu

We then present a novel model named Graph Spatial-Temporal Network Based on Causal Insight (GT-CausIn), where prior learned causal information is integrated with graph diffusion layers and temporal convolutional network (TCN) layers.

Traffic Prediction

Learning to See Through with Events

no code implementations5 Dec 2022 Lei Yu, Xiang Zhang, Wei Liao, Wen Yang, Gui-Song Xia

Although synthetic aperture imaging (SAI) can achieve the seeing-through effect by blurring out off-focus foreground occlusions while recovering in-focus occluded scenes from multi-view images, its performance is often deteriorated by dense occlusions and extreme lighting conditions.

Detecting Line Segments in Motion-blurred Images with Events

1 code implementation14 Nov 2022 Huai Yu, Hao Li, Wen Yang, Lei Yu, Gui-Song Xia

To robustly detect line segments over motion blurs, we propose to leverage the complementary information of images and events.

3D Reconstruction Line Segment Detection +1

Efficient and Accurate Quantized Image Super-Resolution on Mobile NPUs, Mobile AI & AIM 2022 challenge: Report

2 code implementations7 Nov 2022 Andrey Ignatov, Radu Timofte, Maurizio Denna, Abdel Younes, Ganzorig Gankhuyag, Jingang Huh, Myeong Kyun Kim, Kihwan Yoon, Hyeon-Cheol Moon, Seungho Lee, Yoonsik Choe, Jinwoo Jeong, Sungjei Kim, Maciej Smyl, Tomasz Latkowski, Pawel Kubik, Michal Sokolski, Yujie Ma, Jiahao Chao, Zhou Zhou, Hongfan Gao, Zhengfeng Yang, Zhenbing Zeng, Zhengyang Zhuge, Chenghua Li, Dan Zhu, Mengdi Sun, Ran Duan, Yan Gao, Lingshun Kong, Long Sun, Xiang Li, Xingdong Zhang, Jiawei Zhang, Yaqi Wu, Jinshan Pan, Gaocheng Yu, Jin Zhang, Feng Zhang, Zhe Ma, Hongbin Wang, Hojin Cho, Steve Kim, Huaen Li, Yanbo Ma, Ziwei Luo, Youwei Li, Lei Yu, Zhihong Wen, Qi Wu, Haoqiang Fan, Shuaicheng Liu, Lize Zhang, Zhikai Zong, Jeremy Kwon, Junxi Zhang, Mengyuan Li, Nianxiang Fu, Guanchen Ding, Han Zhu, Zhenzhong Chen, Gen Li, Yuanfan Zhang, Lei Sun, Dafeng Zhang, Neo Yang, Fitz Liu, Jerry Zhao, Mustafa Ayazoglu, Bahri Batuhan Bilecen, Shota Hirose, Kasidis Arunruangsirilert, Luo Ao, Ho Chun Leung, Andrew Wei, Jie Liu, Qiang Liu, Dahai Yu, Ao Li, Lei Luo, Ce Zhu, Seongmin Hong, Dongwon Park, Joonhee Lee, Byeong Hyun Lee, Seunggyu Lee, Se Young Chun, Ruiyuan He, Xuhao Jiang, Haihang Ruan, Xinjian Zhang, Jing Liu, Garas Gendy, Nabil Sabor, Jingchao Hou, Guanghui He

While numerous solutions have been proposed for this problem in the past, they are usually not compatible with low-power mobile NPUs having many computational and memory constraints.

Image Super-Resolution

Motion Robust High-Speed Light-Weighted Object Detection With Event Camera

1 code implementation24 Aug 2022 Bingde Liu, Chang Xu, Wen Yang, Huai Yu, Lei Yu

In this work, we propose a motion robust and high-speed detection pipeline which better leverages the event data.

Data Augmentation object-detection +3

Fast Nearest Convolution for Real-Time Efficient Image Super-Resolution

2 code implementations24 Aug 2022 Ziwei Luo, Youwei Li, Lei Yu, Qi Wu, Zhihong Wen, Haoqiang Fan, Shuaicheng Liu

The proposed nearest convolution has the same performance as the nearest upsampling but is much faster and more suitable for Android NNAPI.

Image Super-Resolution Quantization

RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detection

1 code implementation18 Aug 2022 Chang Xu, Jinwang Wang, Wen Yang, Huai Yu, Lei Yu, Gui-Song Xia

Then, instead of assigning samples with IoU or center sampling strategy, a new Receptive Field Distance (RFD) is proposed to directly measure the similarity between the Gaussian receptive field and ground truth.

Object object-detection +1

MAD for Robust Reinforcement Learning in Machine Translation

no code implementations18 Jul 2022 Domenic Donato, Lei Yu, Wang Ling, Chris Dyer

We introduce a new distributed policy gradient algorithm and show that it outperforms existing reward-aware training procedures such as REINFORCE, minimum risk training (MRT) and proximal policy optimization (PPO) in terms of training stability and generalization performance when optimizing machine translation models.

Machine Translation reinforcement-learning +3

GLF-CR: SAR-Enhanced Cloud Removal with Global-Local Fusion

1 code implementation6 Jun 2022 Fang Xu, Yilei Shi, Patrick Ebel, Lei Yu, Gui-Song Xia, Wen Yang, Xiao Xiang Zhu

The challenge of the cloud removal task can be alleviated with the aid of Synthetic Aperture Radar (SAR) images that can penetrate cloud cover.

Cloud Removal

Noun2Verb: Probabilistic frame semantics for word class conversion

1 code implementation12 May 2022 Lei Yu, Yang Xu

We present a formal framework, Noun2Verb, that simulates the production and comprehension of novel denominal verb usages by modeling shared knowledge of speaker and listener in semantic frames.

NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Results

2 code implementations11 May 2022 Yawei Li, Kai Zhang, Radu Timofte, Luc van Gool, Fangyuan Kong, Mingxi Li, Songwei Liu, Zongcai Du, Ding Liu, Chenhui Zhou, Jingyi Chen, Qingrui Han, Zheyuan Li, Yingqi Liu, Xiangyu Chen, Haoming Cai, Yu Qiao, Chao Dong, Long Sun, Jinshan Pan, Yi Zhu, Zhikai Zong, Xiaoxiao Liu, Zheng Hui, Tao Yang, Peiran Ren, Xuansong Xie, Xian-Sheng Hua, Yanbo Wang, Xiaozhong Ji, Chuming Lin, Donghao Luo, Ying Tai, Chengjie Wang, Zhizhong Zhang, Yuan Xie, Shen Cheng, Ziwei Luo, Lei Yu, Zhihong Wen, Qi Wu1, Youwei Li, Haoqiang Fan, Jian Sun, Shuaicheng Liu, Yuanfei Huang, Meiguang Jin, Hua Huang, Jing Liu, Xinjian Zhang, Yan Wang, Lingshun Long, Gen Li, Yuanfan Zhang, Zuowei Cao, Lei Sun, Panaetov Alexander, Yucong Wang, Minjie Cai, Li Wang, Lu Tian, Zheyuan Wang, Hongbing Ma, Jie Liu, Chao Chen, Yidong Cai, Jie Tang, Gangshan Wu, Weiran Wang, Shirui Huang, Honglei Lu, Huan Liu, Keyan Wang, Jun Chen, Shi Chen, Yuchun Miao, Zimo Huang, Lefei Zhang, Mustafa Ayazoğlu, Wei Xiong, Chengyi Xiong, Fei Wang, Hao Li, Ruimian Wen, Zhijing Yang, Wenbin Zou, Weixin Zheng, Tian Ye, Yuncheng Zhang, Xiangzhen Kong, Aditya Arora, Syed Waqas Zamir, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, Dandan Gaoand Dengwen Zhouand Qian Ning, Jingzhu Tang, Han Huang, YuFei Wang, Zhangheng Peng, Haobo Li, Wenxue Guan, Shenghua Gong, Xin Li, Jun Liu, Wanjun Wang, Dengwen Zhou, Kun Zeng, Hanjiang Lin, Xinyu Chen, Jinsheng Fang

The aim was to design a network for single image super-resolution that achieved improvement of efficiency measured according to several metrics including runtime, parameters, FLOPs, activations, and memory consumption while at least maintaining the PSNR of 29. 00dB on DIV2K validation set.

Image Super-Resolution

Learning to Extract Building Footprints from Off-Nadir Aerial Images

1 code implementation28 Apr 2022 Jinwang Wang, Lingxuan Meng, Weijia Li, Wen Yang, Lei Yu, Gui-Song Xia

In this paper, we propose an offset vector learning scheme, which turns the building footprint extraction problem in off-nadir images into an instance-level joint prediction problem of the building roof and its corresponding "roof to footprint" offset vector.

BSRT: Improving Burst Super-Resolution with Swin Transformer and Flow-Guided Deformable Alignment

1 code implementation18 Apr 2022 Ziwei Luo, Youwei Li, Shen Cheng, Lei Yu, Qi Wu, Zhihong Wen, Haoqiang Fan, Jian Sun, Shuaicheng Liu

To overcome the challenges in BurstSR, we propose a Burst Super-Resolution Transformer (BSRT), which can significantly improve the capability of extracting inter-frame information and reconstruction.

Burst Image Reconstruction Burst Image Super-Resolution +2

Unifying Motion Deblurring and Frame Interpolation with Events

1 code implementation CVPR 2022 Xiang Zhang, Lei Yu

Slow shutter speed and long exposure time of frame-based cameras often cause visual blur and loss of inter-frame information, degenerating the overall quality of captured videos.

Deblurring Self-Supervised Learning +1

Autofocus for Event Cameras

no code implementations CVPR 2022 ShiJie Lin, Yinqiang Zhang, Lei Yu, Bin Zhou, Xiaowei Luo, Jia Pan

Focus control (FC) is crucial for cameras to capture sharp images in challenging real-world scenarios.

Backpropagation through Time and Space: Learning Numerical Methods with Multi-Agent Reinforcement Learning

no code implementations16 Mar 2022 Elliot Way, Dheeraj S. K. Kapilavai, Yiwei Fu, Lei Yu

We introduce Backpropagation Through Time and Space (BPTTS), a method for training a recurrent spatio-temporal neural network, that is used in a homogeneous multi-agent reinforcement learning (MARL) setting to learn numerical methods for hyperbolic conservation laws.

Multi-agent Reinforcement Learning reinforcement-learning +1

Enabling arbitrary translation objectives with Adaptive Tree Search

no code implementations ICLR 2022 Wang Ling, Wojciech Stokowiec, Domenic Donato, Laurent Sartran, Lei Yu, Austin Matthews, Chris Dyer

When applied to autoregressive models, our algorithm has different biases than beam search has, which enables a new analysis of the role of decoding bias in autoregressive models.

Decoder Translation

Synthetic Aperture Imaging With Events and Frames

1 code implementation CVPR 2022 Wei Liao, Xiang Zhang, Lei Yu, ShiJie Lin, Wen Yang, Ning Qiao

This paper addresses this problem by leveraging the merits of both events and frames, leading to a fusion-based SAI (EF-SAI) that performs consistently under the different densities of occlusions.

Decoder feature selection

A Normalized Gaussian Wasserstein Distance for Tiny Object Detection

3 code implementations26 Oct 2021 Jinwang Wang, Chang Xu, Wen Yang, Lei Yu

Our key observation is that Intersection over Union (IoU) based metrics such as IoU itself and its extensions are very sensitive to the location deviation of the tiny objects, and drastically deteriorate the detection performance when used in anchor-based detectors.

Object object-detection +1

Motion Deblurring with Real Events

no code implementations ICCV 2021 Fang Xu, Lei Yu, Bishan Wang, Wen Yang, Gui-Song Xia, Xu Jia, Zhendong Qiao, Jianzhuang Liu

In this paper, we propose an end-to-end learning framework for event-based motion deblurring in a self-supervised manner, where real-world events are exploited to alleviate the performance degradation caused by data inconsistency.


Diverse Pretrained Context Encodings Improve Document Translation

no code implementations ACL 2021 Domenic Donato, Lei Yu, Chris Dyer

We propose a new architecture for adapting a sentence-level sequence-to-sequence transformer by incorporating multiple pretrained document context signals and assess the impact on translation performance of (1) different pretraining approaches for generating these signals, (2) the quantity of parallel data for which document context is available, and (3) conditioning on source, target, or source and target contexts.

Document Translation Sentence +1

Pretraining the Noisy Channel Model for Task-Oriented Dialogue

no code implementations18 Mar 2021 Qi Liu, Lei Yu, Laura Rimell, Phil Blunsom

Direct decoding for task-oriented dialogue is known to suffer from the explaining-away effect, manifested in models that prefer short and generic responses.

End-To-End Dialogue Modelling

Event-based Synthetic Aperture Imaging with a Hybrid Network

1 code implementation CVPR 2021 Xiang Zhang, Wei Liao, Lei Yu, Wen Yang, Gui-Song Xia

Synthetic aperture imaging (SAI) is able to achieve the see through effect by blurring out the off-focus foreground occlusions and reconstructing the in-focus occluded targets from multi-view images.

Decoder Style Transfer

ULSD: Unified Line Segment Detection across Pinhole, Fisheye, and Spherical Cameras

2 code implementations6 Nov 2020 Hao Li, Huai Yu, Wen Yang, Lei Yu, Sebastian Scherer

Targeting at the unified line segment detection (ULSD) for both distorted and undistorted images, we propose to represent line segments with the Bezier curve model.

Line Segment Detection

Inferring symmetry in natural language

1 code implementation Findings of the Association for Computational Linguistics 2020 Chelsea Tanchip, Lei Yu, Aotao Xu, Yang Xu

Our results show that a hybrid transfer learning model that integrates linguistic features with contextualized language models most faithfully predicts the empirical data.

Sentence Transfer Learning

Improving Spiking Sparse Recovery via Non-Convex Penalties

no code implementations19 Sep 2020 Xiang Zhang, Lei Yu, Gang Zheng

Compared with digital methods, sparse recovery based on spiking neural networks has great advantages like high computational efficiency and low power-consumption.

Computational Efficiency

Mixed Noise Removal with Pareto Prior

no code implementations27 Aug 2020 Zhou Liu, Lei Yu, Gui-Song Xia, Hong Sun

To address this problem, we exploit the Pareto distribution as the priori of the weighting matrix, based on which an accurate and robust weight estimator is proposed for mixed noise removal.


Event Enhanced High-Quality Image Recovery

1 code implementation ECCV 2020 Bishan Wang, Jingwei He, Lei Yu, Gui-Song Xia, Wen Yang

To recover high-quality intensity images, one should address both denoising and super-resolution problems for event cameras.

Denoising Sparse Learning +2

Implicit Euler ODE Networks for Single-Image Dehazing

no code implementations13 Jul 2020 Jiawei Shen, Zhuoyan Li, Lei Yu, Gui-Song Xia, Wen Yang

Deep convolutional neural networks (CNN) have been applied for image dehazing tasks, where the residual network (ResNet) is often adopted as the basic component to avoid the vanishing gradient problem.

Image Dehazing Single Image Dehazing

Kernel Learning for High-Resolution Time-Frequency Distribution

1 code implementation1 Jul 2020 Lei Jiang, Haijian Zhang, Lei Yu, Guang Hua

To break the current limitation, we propose a data-driven kernel learning model directly based on Wigner-Ville distribution (WVD).

Vocal Bursts Intensity Prediction

IsarStep: a Benchmark for High-level Mathematical Reasoning

2 code implementations ICLR 2021 Wenda Li, Lei Yu, Yuhuai Wu, Lawrence C. Paulson

In this paper, we present a benchmark for high-level mathematical reasoning and study the reasoning capabilities of neural sequence-to-sequence models.

Mathematical Proofs Mathematical Reasoning +1

Robust Time-Frequency Reconstruction by Learning Structured Sparsity

no code implementations30 Apr 2020 Lei Jiang, Haijian Zhang, Lei Yu

Time-frequency distributions (TFDs) play a vital role in providing descriptive analysis of non-stationary signals involved in realistic scenarios.


Matching Neuromorphic Events and Color Images via Adversarial Learning

no code implementations2 Mar 2020 Fang Xu, ShiJie Lin, Wen Yang, Lei Yu, Dengxin Dai, Gui-Song Xia

The event camera has appealing properties: high dynamic range, low latency, low power consumption and low memory usage, and thus provides complementariness to conventional frame-based cameras.

Image Retrieval Retrieval

Edge-Isoperimetric Inequalities and Ball-Noise Stability: Linear Programming and Probabilistic Approaches

no code implementations9 Feb 2020 Lei Yu

Our bounds derived by the second approach are expressed in terms of the \emph{noise stability}, and they are shown to be asymptotically tight as $n\to\infty$ when $r=2\lfloor\frac{\beta n}{2}\rfloor+1$ and $M=\lfloor\alpha2^{n}\rfloor$ for fixed $\alpha,\beta\in(0, 1)$, and is tight up to a factor $2$ when $r=2\lfloor\frac{\beta n}{2}\rfloor$ and $M=\lfloor\alpha2^{n}\rfloor$.

Combinatorics Information Theory Information Theory Probability

Effects of Differential Privacy and Data Skewness on Membership Inference Vulnerability

no code implementations21 Nov 2019 Stacey Truex, Ling Liu, Mehmet Emre Gursoy, Wenqi Wei, Lei Yu

Second, through MPLens, we highlight how the vulnerability of pre-trained models under membership inference attack is not uniform across all classes, particularly when the training data itself is skewed.

Inference Attack Membership Inference Attack

Maximum Entropy Diverse Exploration: Disentangling Maximum Entropy Reinforcement Learning

no code implementations3 Nov 2019 Andrew Cohen, Lei Yu, Xingye Qiao, Xiangrong Tong

A theoretical investigation shows that the set of policies learned by MEDE capture the same modalities as the optimal maximum entropy policy.

reinforcement-learning Reinforcement Learning (RL)

A Mutual Information Maximization Perspective of Language Representation Learning

no code implementations ICLR 2020 Lingpeng Kong, Cyprien de Masson d'Autume, Wang Ling, Lei Yu, Zihang Dai, Dani Yogatama

We show state-of-the-art word representation learning methods maximize an objective function that is a lower bound on the mutual information between different parts of a word sequence (i. e., a sentence).

Representation Learning Sentence

Learning Cluster Structured Sparsity by Reweighting

no code implementations11 Oct 2019 Yulun Jiang, Lei Yu, Haijian Zhang, Zhou Liu

Recently, the paradigm of unfolding iterative algorithms into finite-length feed-forward neural networks has achieved a great success in the area of sparse recovery.

Sparse Learning

Better Document-Level Machine Translation with Bayes' Rule

no code implementations TACL 2020 Lei Yu, Laurent Sartran, Wojciech Stokowiec, Wang Ling, Lingpeng Kong, Phil Blunsom, Chris Dyer

We show that Bayes' rule provides an effective mechanism for creating document translation models that can be learned from only parallel sentences and monolingual documents---a compelling benefit as parallel documents are not always available.

Document Level Machine Translation Document Translation +4

Relative Pixel Prediction For Autoregressive Image Generation

no code implementations25 Sep 2019 Wang Ling, Chris Dyer, Lei Yu, Lingpeng Kong, Dani Yogatama, Susannah Young

In natural images, transitions between adjacent pixels tend to be smooth and gradual, a fact that has long been exploited in image compression models based on predictive coding.

Colorization Image Colorization +4

Putting Machine Translation in Context with the Noisy Channel Model

no code implementations25 Sep 2019 Lei Yu, Laurent Sartran, Wojciech Stokowiec, Wang Ling, Lingpeng Kong, Phil Blunsom, Chris Dyer

We show that Bayes' rule provides a compelling mechanism for controlling unconditional document language models, using the long-standing challenge of effectively leveraging document context in machine translation.

Document Translation Language Modelling +3

CRNet: Image Super-Resolution Using A Convolutional Sparse Coding Inspired Network

no code implementations3 Aug 2019 Menglei Zhang, Zhou Liu, Lei Yu

Convolutional Sparse Coding (CSC) has been attracting more and more attention in recent years, for making full use of image global correlation to improve performance on various computer vision applications.

Image Super-Resolution

Deep learning scheme for recovery of broadband microwave photonic receiving systems in transceivers without expert knowledge and system priors

no code implementations17 Jul 2019 Shaofu Xu, Rui Wang, Jianping Chen, Lei Yu, Weiwen Zou

However, the quality of the signals may be degraded by defective photonic analog links, especially in a complicated MWP system.

Facial Feature Embedded CycleGAN for VIS-NIR Translation

no code implementations20 Apr 2019 Huijiao Wang, Li Wang, Xulei Yang, Lei Yu, Haijian Zhang

VIS-NIR face recognition remains a challenging task due to the distinction between spectral components of two modalities and insufficient paired training data.

Face Recognition Translation

Intra-Ensemble in Neural Networks

no code implementations9 Apr 2019 Yuan Gao, Zixiang Cai, Lei Yu

In this work, we propose Intra-Ensemble, an end-to-end ensemble strategy with stochastic channel recombination operations to train several sub-networks simultaneously within one neural network.

Differentially Private Model Publishing for Deep Learning

no code implementations3 Apr 2019 Lei Yu, Ling Liu, Calton Pu, Mehmet Emre Gursoy, Stacey Truex

However, when the training datasets are crowdsourced from individuals and contain sensitive information, the model parameters may encode private information and bear the risks of privacy leakage.

Diverse Exploration via Conjugate Policies for Policy Gradient Methods

no code implementations10 Feb 2019 Andrew Cohen, Xingye Qiao, Lei Yu, Elliot Way, Xiangrong Tong

We address the challenge of effective exploration while maintaining good performance in policy gradient methods.

Policy Gradient Methods

Learning and Evaluating General Linguistic Intelligence

no code implementations31 Jan 2019 Dani Yogatama, Cyprien de Masson d'Autume, Jerome Connor, Tomas Kocisky, Mike Chrzanowski, Lingpeng Kong, Angeliki Lazaridou, Wang Ling, Lei Yu, Chris Dyer, Phil Blunsom

We define general linguistic intelligence as the ability to reuse previously acquired knowledge about a language's lexicon, syntax, semantics, and pragmatic conventions to adapt to new tasks quickly.

Natural Language Understanding Question Answering

Variational Smoothing in Recurrent Neural Network Language Models

no code implementations ICLR 2019 Lingpeng Kong, Gabor Melis, Wang Ling, Lei Yu, Dani Yogatama

We present a new theoretical perspective of data noising in recurrent neural network language models (Xie et al., 2017).

Language Modelling

Image Super-Resolution via RL-CSC: When Residual Learning Meets Convolutional Sparse Coding

no code implementations31 Dec 2018 Menglei Zhang, Zhou Liu, Lei Yu

We extend LISTA to its convolutional version and build the main part of our model by strictly following the convolutional form, which improves the network's interpretability.

Image Super-Resolution

Tackling Sequence to Sequence Mapping Problems with Neural Networks

no code implementations25 Oct 2018 Lei Yu

In Natural Language Processing (NLP), it is important to detect the relationship between two sequences or to generate a sequence of tokens given another observed sequence.

Domain Adaptation Feature Engineering +2

Adversarial Examples in Deep Learning: Characterization and Divergence

no code implementations29 Jun 2018 Wenqi Wei, Ling Liu, Margaret Loper, Stacey Truex, Lei Yu, Mehmet Emre Gursoy, Yanzhao Wu

The burgeoning success of deep learning has raised the security and privacy concerns as more and more tasks are accompanied with sensitive data.

Adversarial Attack

Towards Demystifying Membership Inference Attacks

1 code implementation28 Jun 2018 Stacey Truex, Ling Liu, Mehmet Emre Gursoy, Lei Yu, Wenqi Wei

Our empirical results additionally show that (1) using the type of target model under attack within the attack model may not increase attack effectiveness and (2) collaborative learning in federated systems exposes vulnerabilities to membership inference risks when the adversary is a participant in the federation.

Cryptography and Security

Diverse Exploration for Fast and Safe Policy Improvement

no code implementations22 Feb 2018 Andrew Cohen, Lei Yu, Robert Wright

We study an important yet under-addressed problem of quickly and safely improving policies in online reinforcement learning domains.

reinforcement-learning Reinforcement Learning (RL)

Automatic Streaming Segmentation of Stereo Video Using Bilateral Space

no code implementations10 Oct 2017 Wenjing Ke, Yuanjie Zhu, Lei Yu

In this paper, we take advantage of binocular camera and propose an unsupervised algorithm based on semi-supervised segmentation algorithm and extracting foreground part efficiently.

The Neural Noisy Channel

no code implementations8 Nov 2016 Lei Yu, Phil Blunsom, Chris Dyer, Edward Grefenstette, Tomas Kocisky

We formulate sequence to sequence transduction as a noisy channel decoding problem and use recurrent neural networks to parameterise the source and channel models.

Decoder Machine Translation +3

Online Segment to Segment Neural Transduction

no code implementations EMNLP 2016 Lei Yu, Jan Buys, Phil Blunsom

We introduce an online neural sequence to sequence model that learns to alternate between encoding and decoding segments of the input as it is read.

Morphological Inflection Sentence +1

GPU-FV: Realtime Fisher Vector and Its Applications in Video Monitoring

1 code implementation12 Apr 2016 Wenying Ma, Liangliang Cao, Lei Yu, Guoping Long, Yucheng Li

We also applied GPU-FV for realtime video monitoring tasks and found that GPU-FV outperforms a number of previous works.


Neural Variational Inference for Text Processing

6 code implementations19 Nov 2015 Yishu Miao, Lei Yu, Phil Blunsom

We validate this framework on two very different text modelling applications, generative document modelling and supervised question answering.

Answer Selection Topic Models +1

The SYSU System for the Interspeech 2015 Automatic Speaker Verification Spoofing and Countermeasures Challenge

no code implementations24 Jul 2015 Shitao Weng, Shushan Chen, Lei Yu, Xuewei Wu, Weicheng Cai, Zhi Liu, Ming Li

In order to detect these spoofed speech signals as a countermeasure, we propose a score level fusion approach with several different i-vector subsystems.

Speaker Verification Speech Synthesis +1

Small Instance Detection by Integer Programming on Object Density Maps

no code implementations CVPR 2015 Zheng Ma, Lei Yu, Antoni B. Chan

For each region, a sliding window (ROI) is passed over the density map to calculate the instance count within each ROI.

Novel Object Detection Object +2

Deep Learning for Answer Sentence Selection

2 code implementations4 Dec 2014 Lei Yu, Karl Moritz Hermann, Phil Blunsom, Stephen Pulman

Answer sentence selection is the task of identifying sentences that contain the answer to a given question.

Feature Engineering Open-Domain Question Answering +1

Cannot find the paper you are looking for? You can Submit a new open access paper.