Search Results for author:
Found 48 papers, 14 papers with code
CTAP for Chinese:A Linguistic Complexity Feature Automatic Calculation Platform
The construct of linguistic complexity has been widely used in language learning research.
Striving for Simplicity: Simple Yet Effective Prior-Aware Pseudo-Labeling for Semi-Supervised Ultrasound Image Segmentation
Medical ultrasound imaging is ubiquitous, but manual analysis struggles to keep pace.
Proxy Control Barrier Functions: Integrating Barrier-Based and Lyapunov-Based Safety-Critical Control Design
The proposed method employs a modular design procedure, decomposing the original system into a proxy subsystem and a virtual tracking subsystem that are controlled by the control barrier function (CBF)-based and Lyapunov-based controllers, respectively.
Towards Effective Graph Rationalization via Boosting Environment Diversity
Secondly, to ensure the diversity of augmented samples, we propose an environment diversity augmentation strategy in GRBE that mixes the environment subgraphs of different graphs in the original graph space and then combines the new environment subgraphs with rationale subgraphs to generate augmented graphs.
FlexSP: Accelerating Large Language Model Training via Flexible Sequence Parallelism
Furthermore, we implement our method in a high-performance system that supports adaptive parallelization in distributed LLM training.
Absolute State-wise Constrained Policy Optimization: High-Probability State-wise Constraints Satisfaction
Our insight is that although it is intractable to guarantee hard state-wise constraints in a model-free setting, we can enforce state-wise safety with high probability while excluding strong assumptions.
Spindle: Efficient Distributed Training of Multi-Task Large Models via Wavefront Scheduling
Recent foundation models are capable of handling multiple tasks and multiple data modalities with the unified base model structure and several specialized model components.
First Activations Matter: Training-Free Methods for Dynamic Activation in Large Language Models
Dynamic activation (DA) techniques, such as DejaVu and MoEfication, have demonstrated their potential to significantly enhance the inference efficiency of large language models (LLMs).
Safe Adaptive Control for Uncertain Systems with Complex Input Constraints
We design an adaptive CBF-based controller to manage the mismatched uncertainties introduced by this transformation.
Pupil-Adaptive 3D Holography Beyond Coherent Depth-of-Field
Recent holographic display approaches propelled by deep learning have shown remarkable success in enabling high-fidelity holographic projections.
MOYU: A Theoretical Study on Massive Over-activation Yielded Uplifts in LLMs
Massive Over-activation Yielded Uplifts(MOYU) is an inherent property of large language models, and dynamic activation(DA) based on the MOYU property is a clever yet under-explored strategy designed to accelerate inference in these models.
QQQ: Quality Quattuor-Bit Quantization for Large Language Models
Quantization is a proven effective method for compressing large language models.
DOF-GS: Adjustable Depth-of-Field 3D Gaussian Splatting for Post-Capture Refocusing, Defocus Rendering and Blur Removal
3D Gaussian Splatting (3DGS) techniques have recently enabled high-quality 3D scene reconstruction and real-time novel view synthesis.
LSEnet: Lorentz Structural Entropy Neural Network for Deep Graph Clustering
DSI is also theoretically presented as a new graph clustering objective, not requiring the predefined cluster number.
Dynamic Activation Pitfalls in LLaMA Models: An Empirical Study
In this work, we systematically investigate the efficacy of dynamic activation mechanisms within the LLaMA family of language models.
Cross-domain Chinese Sentence Pattern Parsing
Sentence Pattern Structure (SPS) parsing is a syntactic analysis method primarily employed in language teaching. Existing SPS parsers rely heavily on textbook corpora for training, lacking cross-domain capability. To overcome this constraint, this paper proposes an innovative approach leveraging large language models (LLMs) within a self-training framework.
From Text to CQL: Bridging Natural Language and Corpus Search Engine
This paper presents the first text-to-CQL task that aims to automate the translation of natural language into CQL.
Weaver: Foundation Models for Creative Writing
Weaver is pre-trained on a carefully selected corpus that focuses on improving the writing capabilities of large language models.
Quantum-Enhanced Forecasting: Leveraging Quantum Gramian Angular Field and CNNs for Stock Return Predictions
We propose a time series forecasting method named Quantum Gramian Angular Field (QGAF).
Immersion and Invariance-based Disturbance Observer and Its Application to Safe Control
When the disturbance input matrix is nonlinear, existing disturbance observer design methods rely on the solvability of a partial differential equation or the existence of an output function with a uniformly well-defined disturbance relative degree, which can pose significant limitations.
Revisiting Prompt Engineering via Declarative Crowdsourcing
Large language models (LLMs) are incredibly powerful at comprehending and generating data in the form of text, but are brittle and error-prone.
Improving Automatic Parallel Training via Balanced Memory Workload Optimization
Transformer models have emerged as the leading approach for achieving state-of-the-art performance across various application domains, serving as the foundation for advanced large-scale deep learning (DL) models.
Cost-efficient Crowdsourcing for Span-based Sequence Labeling: Worker Selection and Data Augmentation
This paper introduces a novel crowdsourcing worker selection algorithm, enhancing annotation quality and reducing costs.
Adaptive Safety-Critical Control for a Class of Nonlinear Systems with Parametric Uncertainties: A Control Barrier Function Approach
This paper presents a novel approach for the safe control design of systems with parametric uncertainties in both drift terms and control-input matrices.
Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism
Transformer models have achieved state-of-the-art performance on various domains of applications and gradually becomes the foundations of the advanced large deep learning (DL) models.
SinGRAV: Learning a Generative Radiance Volume from a Single Natural Scene
We present a 3D generative model for general natural scenes.
DTG-SSOD: Dense Teacher Guidance for Semi-Supervised Object Detection
Specifically, we propose the Inverse NMS Clustering (INC) and Rank Matching (RM) to instantiate the dense supervision, without the widely used, conventional sparse pseudo labels.
BLCU-ICALL at SemEval-2022 Task 1: Cross-Attention Multitasking Framework for Definition Modeling
This paper describes the BLCU-ICALL system used in the SemEval-2022 Task 1 Comparing Dictionaries and Word Embeddings, the Definition Modeling subtrack, achieving 1st on Italian, 2nd on Spanish and Russian, and 3rd on English and French.
The Tree Loss: Improving Generalization with Many Classes
We introduce the tree loss as a drop-in replacement for the cross entropy loss.
PseCo: Pseudo Labeling and Consistency Training for Semi-Supervised Object Detection
Specifically, for pseudo labeling, existing works only focus on the classification score yet fail to guarantee the localization precision of pseudo boxes; For consistency training, the widely adopted random-resize training only considers the label-level consistency but misses the feature-level one, which also plays an important role in ensuring the scale invariance.
Disturbance Observer-based Robust Control Barrier Functions
This work presents a safe control design approach that integrates the disturbance observer (DOB) and the control barrier function (CBF) for systems with external disturbances.
Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-guided Feature Imitation
Based on the two observations, we propose Rank Mimicking (RM) and Prediction-guided Feature Imitation (PFI) for distilling one-stage detectors, respectively.
Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generation
We show that with the help of a content-rich discrete visual codebook from VQ-VAE, the discrete diffusion model can also generate high fidelity images with global context, which compensates for the deficiency of the classical autoregressive model along pixel space.
One to Transfer All: A Universal Transfer Framework for Vision Foundation Model with Few Data
Transferring with few data in a general way to thousands of downstream tasks is becoming a trend of the foundation model's application.
INTERN: A New Learning Paradigm Towards General Vision
Enormous waves of technological innovations over the past several years, marked by the advances in AI technologies, are profoundly reshaping the industry and the society.
Hierarchical Segment-based Optimization for SLAM
This paper presents a hierarchical segment-based optimization method for Simultaneous Localization and Mapping (SLAM) system.
Neural Implicit 3D Shapes from Single Images with Spatial Patterns
However, the image features for describing 3D point samplings of implicit functions are less effective when significant variations of occlusions, views, and appearances exist from the image.
Fixing the Teacher-Student Knowledge Discrepancy in Distillation
To solve this problem, in this paper, we propose a novel student-dependent distillation method, knowledge consistent distillation, which makes teacher's knowledge more consistent with the student and provides the best suitable knowledge to different student networks for distillation.
Differentiable Network Adaption with Elastic Search Space
In this paper we propose a novel network adaption method called Differentiable Network Adaption (DNA), which can adapt an existing network to a specific computation budget by adjusting the width and depth in a differentiable manner.
A Collaborative Visual SLAM Framework for Service Robots
We present a collaborative visual simultaneous localization and mapping (SLAM) framework for service robots.
Multi-scale Network Architecture Search for Object Detection
Many commonly-used detection frameworks aim to handle the multi-scale object detection problem.
DMCP: Differentiable Markov Channel Pruning for Neural Networks
In DMCP, we model the channel pruning as a Markov process, in which each state represents for retaining the corresponding channel during pruning, and transitions between states denote the pruning process.
TiSASRec: Time Interval Aware Self-Attention for Sequential Recommendation
Sequential recommender systems seek to exploit the order of users' interactions, in order to predict their next action based on the context of what they have done recently.
Single image reflection removal via learning with multi-image constraints
Reflections are very common phenomena in our daily photography, which distract people's attention from the scene behind the glass.
DeGNN: Characterizing and Improving Graph Neural Networks with Graph Decomposition
Despite the wide application of Graph Convolutional Network (GCN), one major limitation is that it does not benefit from the increasing depth and suffers from the oversmoothing problem.
Skin Lesion Segmentation Using Atrous Convolution via DeepLab v3
As melanoma diagnoses increase across the US, automated efforts to identify malignant lesions become increasingly of interest to the research community.
Beyond Trade-off: Accelerate FCN-based Face Detector with Higher Accuracy
Fully convolutional neural network (FCN) has been dominating the game of face detection task for a few years with its congenital capability of sliding-window-searching with shared kernels, which boiled down all the redundant calculation, and most recent state-of-the-art methods such as Faster-RCNN, SSD, YOLO and FPN use FCN as their backbone.
Flow-Guided Feature Aggregation for Video Object Detection
The accuracy of detection suffers from degenerated object appearances in videos, e. g., motion blur, video defocus, rare poses, etc.
Ranked #28 on
Video Object Detection
on ImageNet VID
