Search Results for author: Yijun Yang

Found 33 papers, 21 papers with code

System-2 Mathematical Reasoning via Enriched Instruction Tuning

no code implementations22 Dec 2024 Huanqia Cai, Yijun Yang, Zhifeng Li

Unlike existing CoT prompting methods that generate reasoning chains only depending on LLM's internal knowledge, our method leverages human-annotated initial answers as ``meta-knowledge'' to help LLMs generate more detailed and precise reasoning processes, leading to a more trustworthy LLM expert for complex mathematical problems.

ERP GSM8K +2

From An LLM Swarm To A PDDL-Empowered HIVE: Planning Self-Executed Instructions In A Multi-Modal Jungle

no code implementations17 Dec 2024 Kaustubh Vyas, Damien Graux, Yijun Yang, Sébastien Montella, Chenxin Diao, Wendi Zhou, Pavlos Vougiouklis, Ruofei Lai, Yang Ren, Keshuang Li, Jeff Z. Pan

In response to the call for agent-based solutions that leverage the ever-increasing capabilities of the deep models' ecosystem, we introduce Hive -- a comprehensive solution for selecting appropriate models and subsequently planning a set of atomic actions to satisfy the end-users' instructions.

AI Agent Formal Logic +3

DRIVE: Dual-Robustness via Information Variability and Entropic Consistency in Source-Free Unsupervised Domain Adaptation

no code implementations24 Nov 2024 Ruiqiang Xiao, Songning Lai, Yijun Yang, Jiemin Wu, Yutao Yue, Lei Zhu

The adaptation process has two stages: the first aligns the models on stable features using a mutual information consistency loss, and the second dynamically adjusts the perturbation level based on the loss from the first stage, encouraging the model to explore a broader range of the target domain while preserving existing performance.

Autonomous Driving Unsupervised Domain Adaptation

Semi-Supervised Video Desnowing Network via Temporal Decoupling Experts and Distribution-Driven Contrastive Regularization

1 code implementation10 Oct 2024 Hongtao Wu, Yijun Yang, Angelica I Aviles-Rivero, Jingjing Ren, Sixiang Chen, Haoyu Chen, Lei Zhu

Specifically, we construct a real-world dataset with 85 snowy videos, and then present a Semi-supervised Video Desnowing Network (SemiVDN) equipped by a novel Distribution-driven Contrastive Regularization.

Ranked #2 on Snow Removal on RVSD (using extra training data)

Snow Removal

Diff-VPS: Video Polyp Segmentation via a Multi-task Diffusion Network with Adversarial Temporal Reasoning

1 code implementation11 Sep 2024 Yingling Lu, Yijun Yang, Zhaohu Xing, Qiong Wang, Lei Zhu

We incorporate multi-task supervision into diffusion models to promote the discrimination of diffusion models on pixel-by-pixel segmentation.

Segmentation Video Polyp Segmentation

RainMamba: Enhanced Locality Learning with State Space Models for Video Deraining

1 code implementation31 Jul 2024 Hongtao Wu, Yijun Yang, Huihui Xu, Weiming Wang, Jinni Zhou, Lei Zhu

Recently, the linear-complexity operator of the state space models (SSMs) has contrarily facilitated efficient long-term temporal modeling, which is crucial for rain streaks and raindrops removal in videos.

Optical Flow Estimation Rain Removal +3

Driving-Video Dehazing with Non-Aligned Regularization for Safety Assistance

no code implementations CVPR 2024 Junkai Fan, Jiangwei Weng, Kun Wang, Yijun Yang, Jianjun Qian, Jun Li, Jian Yang

Firstly, we introduce a non-aligned reference frame matching module, leveraging an adaptive sliding window to match high-quality reference frames from clear videos.

UniArk: Improving Generalisation and Consistency for Factual Knowledge Extraction through Debiasing

1 code implementation1 Apr 2024 Yijun Yang, Jie He, Pinzhen Chen, Víctor Gutiérrez-Basulto, Jeff Z. Pan

We hypothesize that simultaneously debiasing these objectives can be the key to generalisation over unseen prompts.

Genuine Knowledge from Practice: Diffusion Test-Time Adaptation for Video Adverse Weather Removal

1 code implementation CVPR 2024 Yijun Yang, Hongtao Wu, Angelica I. Aviles-Rivero, Yulun Zhang, Jing Qin, Lei Zhu

Although ViWS-Net is proposed to remove adverse weather conditions in videos with a single set of pre-trained weights, it is seriously blinded by seen weather at train-time and degenerates when coming to unseen weather during test-time.

Test-time Adaptation

GuardT2I: Defending Text-to-Image Models from Adversarial Prompts

1 code implementation3 Mar 2024 Yijun Yang, Ruiyuan Gao, Xiao Yang, Jianyuan Zhong, Qiang Xu

Recent advancements in Text-to-Image (T2I) models have raised significant safety concerns about their potential misuse for generating inappropriate or Not-Safe-For-Work (NSFW) contents, despite existing countermeasures such as NSFW classifiers or model fine-tuning for inappropriate concept removal.

Binary Classification Language Modeling +2

Vivim: a Video Vision Mamba for Medical Video Segmentation

1 code implementation25 Jan 2024 Yijun Yang, Zhaohu Xing, Chunwang Huang, Lei Zhu

To this end, this paper presents a Video Vision Mamba-based framework, dubbed as Vivim, for medical video segmentation tasks.

Lesion Segmentation Mamba +5

SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentation

1 code implementation24 Jan 2024 Zhaohu Xing, Tian Ye, Yijun Yang, Guang Liu, Lei Zhu

Our SegMamba, in contrast to Transformer-based methods, excels in whole volume feature modeling from a state space model standpoint, maintaining superior processing speed, even with volume features at a resolution of {$64\times 64\times 64$}.

Image Segmentation Mamba +2

MMA-Diffusion: MultiModal Attack on Diffusion Models

2 code implementations CVPR 2024 Yijun Yang, Ruiyuan Gao, Xiaosen Wang, Tsung-Yi Ho, Nan Xu, Qiang Xu

In recent years, Text-to-Image (T2I) models have seen remarkable advancements, gaining widespread adoption.

Embodied Multi-Modal Agent trained by an LLM from a Parallel TextWorld

1 code implementation CVPR 2024 Yijun Yang, Tianyi Zhou, Kanxue Li, Dapeng Tao, Lusong Li, Li Shen, Xiaodong He, Jing Jiang, Yuhui Shi

While large language models (LLMs) excel in a simulated world of texts, they struggle to interact with the more realistic world without perceptions of other modalities such as visual or audio signals.

Imitation Learning

Video Adverse-Weather-Component Suppression Network via Weather Messenger and Adversarial Backpropagation

1 code implementation ICCV 2023 Yijun Yang, Angelica I. Aviles-Rivero, Huazhu Fu, Ye Liu, Weiming Wang, Lei Zhu

In this work, we propose the first framework for restoring videos from all adverse weather conditions by developing a video adverse-weather-component suppression network (ViWS-Net).

Decoder

Continual Task Allocation in Meta-Policy Network via Sparse Prompting

1 code implementation29 May 2023 Yijun Yang, Tianyi Zhou, Jing Jiang, Guodong Long, Yuhui Shi

We address it by "Continual Task Allocation via Sparse Prompting (CoTASP)", which learns over-complete dictionaries to produce sparse masks as prompts extracting a sub-network for each task from a meta-policy network.

DiffMIC: Dual-Guidance Diffusion Network for Medical Image Classification

1 code implementation19 Mar 2023 Yijun Yang, Huazhu Fu, Angelica I. Aviles-Rivero, Carola-Bibiane Schönlieb, Lei Zhu

However, while a substantial amount of diffusion-based research has focused on generative tasks, few studies have applied diffusion models to general medical image classification.

Diabetic Retinopathy Grading Image Classification +3

Be Your Own Neighborhood: Detecting Adversarial Example by the Neighborhood Relations Built on Self-Supervised Learning

no code implementations31 Aug 2022 Zhiyuan He, Yijun Yang, Pin-Yu Chen, Qiang Xu, Tsung-Yi Ho

Empowered by the robust relation net built on SSL, we found that BEYOND outperforms baselines in terms of both detection ability and speed.

Relation Self-Supervised Learning

Out-of-Distribution Detection with Semantic Mismatch under Masking

1 code implementation31 Jul 2022 Yijun Yang, Ruiyuan Gao, Qiang Xu

This paper proposes a novel out-of-distribution (OOD) detection framework named MoodCat for image classifiers.

Out-of-Distribution Detection Out of Distribution (OOD) Detection

Pareto Policy Pool for Model-based Offline Reinforcement Learning

no code implementations ICLR 2022 Yijun Yang, Jing Jiang, Tianyi Zhou, Jie Ma, Yuhui Shi

Model-based offline RL instead trains an environment model using a dataset of pre-collected experiences so online RL methods can learn in an offline manner by solely interacting with the model.

D4RL Offline RL +3

HCDG: A Hierarchical Consistency Framework for Domain Generalization on Medical Image Segmentation

1 code implementation13 Sep 2021 Yijun Yang, Shujun Wang, Lei Zhu, Lequan Yu

Particularly, for the Extrinsic Consistency, we leverage the knowledge across multiple source domains to enforce data-level consistency.

Data Augmentation Domain Generalization +4

The distance between the weights of the neural network is meaningful

no code implementations31 Jan 2021 Liqun Yang, Yijun Yang, Yao Wang, Zhenyu Yang, Wei Zeng

In the application of neural networks, we need to select a suitable model based on the problem complexity and the dataset scale.

Cannot find the paper you are looking for? You can Submit a new open access paper.