Search Results for author: Weijian Li

Found 26 papers, 10 papers with code

Outlier-Efficient Hopfield Layers for Large Transformer-Based Models

1 code implementation4 Apr 2024 Jerry Yao-Chieh Hu, Pei-Hsuan Chang, Robin Luo, Hong-Yu Chen, Weijian Li, Wei-Po Wang, Han Liu

Interestingly, this memory model manifests a model-based interpretation of an outlier-efficient attention mechanism ($\text{Softmax}_1$): it is an approximation of the memory retrieval process of $\mathtt{OutEffHop}$.

Benchmarking Quantization +1

BiSHop: Bi-Directional Cellular Learning for Tabular Data with Generalized Sparse Modern Hopfield Model

1 code implementation4 Apr 2024 Chenwei Xu, Yu-Chao Huang, Jerry Yao-Chieh Hu, Weijian Li, Ammar Gilani, Hsi-Sheng Goan, Han Liu

We introduce the \textbf{B}i-Directional \textbf{S}parse \textbf{Hop}field Network (\textbf{BiSHop}), a novel end-to-end framework for deep tabular learning.

Representation Learning

STanHop: Sparse Tandem Hopfield Model for Memory-Enhanced Time Series Prediction

1 code implementation28 Dec 2023 Dennis Wu, Jerry Yao-Chieh Hu, Weijian Li, Bo-Yu Chen, Han Liu

We present STanHop-Net (Sparse Tandem Hopfield Network) for multivariate time series prediction with memory-enhanced capabilities.

Retrieval Time Series +1

DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genome

4 code implementations26 Jun 2023 Zhihan Zhou, Yanrong Ji, Weijian Li, Pratik Dutta, Ramana Davuluri, Han Liu

Decoding the linguistic intricacies of the genome is a crucial problem in biology, and pre-trained foundational models such as DNABERT and Nucleotide Transformer have made significant strides in this area.

Computational Efficiency Core Promoter Detection +9

Feature Programming for Multivariate Time Series Prediction

1 code implementation9 Jun 2023 Alex Reneau, Jerry Yao-Chieh Hu, Chenwei Xu, Weijian Li, Ammar Gilani, Han Liu

We introduce the concept of programmable feature engineering for time series modeling and propose a feature programming framework.

Automated Feature Engineering Feature Engineering +3

Communication-Efficient Topologies for Decentralized Learning with $O(1)$ Consensus Rate

1 code implementation14 Oct 2022 Zhuoqing Song, Weijian Li, Kexin Jin, Lei Shi, Ming Yan, Wotao Yin, Kun Yuan

In the proposed family, EquiStatic has a degree of $\Theta(\ln(n))$, where $n$ is the network size, and a series of time-dependent one-peer topologies, EquiDyn, has a constant degree of 1.

Causal Inference via Nonlinear Variable Decorrelation for Healthcare Applications

no code implementations29 Sep 2022 Junda Wang, Weijian Li, Han Wang, Hanjia Lyu, Caroline Thirukumaran, Addisu Mesfin, Jiebo Luo

Causal inference and model interpretability research are gaining increasing attention, especially in the domains of healthcare and bioinformatics.

Causal Inference

Product Information Browsing Support System Using Analytic Hierarchy Process

no code implementations17 Dec 2021 Weijian Li, Masato Kikuchi, Tadachika Ozono

Large-scale e-commerce sites can collect and analyze a large number of user preferences and behaviors, and thus can recommend highly trusted products to users.

Decision Making Information Retrieval +1

Scalable Semi-supervised Landmark Localization for X-ray Images using Few-shot Deep Adaptive Graph

no code implementations29 Apr 2021 Xiao-Yun Zhou, Bolin Lai, Weijian Li, Yirui Wang, Kang Zheng, Fakai Wang, ChiHung Lin, Le Lu, Lingyun Huang, Mei Han, Guotong Xie, Jing Xiao, Kuo Chang-Fu, Adam Harrison, Shun Miao

It first trains a DAG model on the labeled data and then fine-tunes the pre-trained model on the unlabeled data with a teacher-student SSL mechanism.

ConTNet: Why not use convolution and transformer at the same time?

2 code implementations27 Apr 2021 Haotian Yan, Zhe Li, Weijian Li, Changhu Wang, Ming Wu, Chuang Zhang

It is also worth pointing that, given identical strong data augmentations, the performance improvement of ConTNet is more remarkable than that of ResNet.

Image Classification object-detection +1

Contour Transformer Network for One-shot Segmentation of Anatomical Structures

1 code implementation2 Dec 2020 Yuhang Lu, Kang Zheng, Weijian Li, Yirui Wang, Adam P. Harrison, ChiHung Lin, Song Wang, Jing Xiao, Le Lu, Chang-Fu Kuo, Shun Miao

In this work, we present Contour Transformer Network (CTN), a one-shot anatomy segmentation method with a naturally built-in human-in-the-loop mechanism.

Anatomy One-Shot Learning +2

Blind signal decomposition of various word embeddings based on join and individual variance explained

no code implementations30 Nov 2020 Yikai Wang, Weijian Li

We found that by mapping different word embeddings into the joint component, sentiment performance can be greatly improved for the original word embeddings with lower performance.

Dimensionality Reduction Sentiment Analysis +1

Anatomy-Aware Siamese Network: Exploiting Semantic Asymmetry for Accurate Pelvic Fracture Detection in X-ray Images

no code implementations ECCV 2020 Haomin Chen, Yirui Wang, Kang Zheng, Weijian Li, Chi-Tung Cheng, Adam P. Harrison, Jing Xiao, Gregory D. Hager, Le Lu, Chien-Hung Liao, Shun Miao

A new contrastive feature learning component in our Siamese network is designed to optimize the deep image features being more salient corresponding to the underlying semantic asymmetries (caused by pelvic fracture occurrences).


Alleviating the Incompatibility between Cross Entropy Loss and Episode Training for Few-shot Skin Disease Classification

no code implementations21 Apr 2020 Wei Zhu, Haofu Liao, Wenbin Li, Weijian Li, Jiebo Luo

Inspired by the recent success of Few-Shot Learning (FSL) in natural image classification, we propose to apply FSL to skin disease identification to address the extreme scarcity of training sample problem.

Few-Shot Learning General Classification +2

Unsupervised Learning of Landmarks based on Inter-Intra Subject Consistencies

1 code implementation16 Apr 2020 Weijian Li, Haofu Liao, Shun Miao, Le Lu, Jiebo Luo

To recover from the transformed images back to the original subject, the landmark detector is forced to learn spatial locations that contain the consistent semantic meanings both for the paired intra-subject images and between the paired inter-subject images.

Uncovering Download Fraud Activities in Mobile App Markets

no code implementations5 Jul 2019 Yingtong Dou, Weijian Li, Zhirong Liu, Zhenhua Dong, Jiebo Luo, Philip S. Yu

To the best of our knowledge, this is the first work that investigates the download fraud problem in mobile App markets.

Patch Transformer for Multi-tagging Whole Slide Histopathology Images

no code implementations10 Jun 2019 Weijian Li, Viet-Duy Nguyen, Haofu Liao, Matt Wilder, Ke Cheng, Jiebo Luo

Automated whole slide image (WSI) tagging has become a growing demand due to the increasing volume and diversity of WSIs collected nowadays in histopathology.


Attentive Relational Networks for Mapping Images to Scene Graphs

no code implementations CVPR 2019 Mengshi Qi, Weijian Li, Zhengyuan Yang, Yunhong Wang, Jiebo Luo

Scene graph generation refers to the task of automatically mapping an image into a semantic structural graph, which requires correctly labeling each extracted object and their interaction relationships.

Graph Generation Object +4

Cannot find the paper you are looking for? You can Submit a new open access paper.