Search Results for author:
Found 23 papers, 17 papers with code
Generative Iris Prior Embedded Transformer for Iris Restoration
In this work, we propose a generative iris prior embedded Transformer model (Gformer), in which we build a hierarchical encoder-decoder network employing Transformer block and generative iris prior.
GIEBench: Towards Holistic Evaluation of Group Identity-based Empathy for Large Language Models
As large language models (LLMs) continue to develop and gain widespread application, the ability of LLMs to exhibit empathy towards diverse group identities and understand their perspectives is increasingly recognized as critical.
MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMs
Current multimodal misinformation detection (MMD) methods often assume a single source and type of forgery for each sample, which is insufficient for real-world scenarios where multiple forgery sources coexist.
Mini Honor of Kings: A Lightweight Environment for Multi-Agent Reinforcement Learning
To address these issues, we introduce the first publicly available map editor for the popular mobile game Honor of Kings and design a lightweight environment, Mini Honor of Kings (Mini HoK), for researchers to conduct experiments.
Localize, Understand, Collaborate: Semantic-Aware Dragging via Intention Reasoner
Specifically, semantic guidance is derived by establishing a semantic editing direction based on reasoned intentions, while quality guidance is achieved through classifier guidance using an image fidelity discriminator.
Rethinking Class-Incremental Learning from a Dynamic Imbalanced Learning Perspective
We argue that the imbalance between old task and new task data contributes to forgetting of the old tasks.
CLIP model is an Efficient Online Lifelong Learner
Online Lifelong Learning (OLL) addresses the challenge of learning from continuous and non-stationary data streams.
Dynamic Generation of Personalities with Large Language Models
We propose a new metric to assess personality generation capability based on this evaluation method.
FKA-Owl: Advancing Multimodal Fake News Detection through Knowledge-Augmented LVLMs
The massive generation of multimodal fake news involving both text and images exhibits substantial distribution discrepancies, prompting the need for generalized detectors.
LLMArena: Assessing Capabilities of Large Language Models in Dynamic Multi-Agent Environments
Recent advancements in large language models (LLMs) have revealed their potential for achieving autonomous agents possessing human-level intelligence.
MORE-3S:Multimodal-based Offline Reinforcement Learning with Shared Semantic Spaces
Drawing upon the intuition that aligning different modalities to the same semantic embedding space would allow models to understand states and actions more easily, we propose a new perspective to the offline reinforcement learning (RL) challenge.
HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts
The Mixture of Experts (MoE) for language models has been proven effective in augmenting the capacity of models by dynamically routing each input token to a specific subset of experts for processing.
Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction
Drawing inspiration from the success of multimodal instruction tuning in visual tasks, we treat the visual-based RL task as a long-horizon vision task and construct a set of multimodal game instructions to incorporate instruction tuning into a decision transformer.
Exploring 3D-aware Lifespan Face Aging via Disentangled Shape-Texture Representations
Existing face aging methods often focus on modeling either texture aging or using an entangled shape-texture representation to achieve face aging.
InstaStyle: Inversion Noise of a Stylized Image is Secretly a Style Adviser
We employ DDIM inversion to extract this noise from the reference image and leverage a diffusion model to generate new stylized images from the "style" noise.
JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models
Achieving human-like planning and control with multimodal observations in an open world is a key milestone for more functional generalist agents.
Prototype-based HyperAdapter for Sample-Efficient Multi-task Tuning
Parameter-efficient fine-tuning (PEFT) has shown its effectiveness in adapting the pre-trained language models to downstream tasks while only updating a small number of parameters.
Learning-to-Rank Meets Language: Boosting Language-Driven Ordering Alignment for Ordinal Classification
Consequently, we propose a cross-modal ordinal pairwise loss to refine the CLIP feature space, where texts and images maintain both semantic alignment and ordering alignment.
Deep Reinforcement Learning with Task-Adaptive Retrieval via Hypernetwork
Deep reinforcement learning algorithms are usually impeded by sampling inefficiency, heavily depending on multiple interactions with the environment to acquire accurate decision-making capabilities.
Towards Spatio-temporal Sea Surface Temperature Forecasting via Static and Dynamic Learnable Personalized Graph Convolution Network
Sea surface temperature (SST) is uniquely important to the Earth's atmosphere since its dynamics are a major force in shaping local and global climate and profoundly affect our ecosystems.
CHATEDIT: Towards Multi-turn Interactive Facial Image Editing via Dialogue
This paper explores interactive facial image editing via dialogue and introduces the ChatEdit benchmark dataset for evaluating image editing and conversation abilities in this context.
Pluralistic Aging Diffusion Autoencoder
Face aging is an ill-posed problem because multiple plausible aging patterns may correspond to a given input.
Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspective
Adversarial machine learning (AML) studies the adversarial phenomenon of machine learning, which may make inconsistent or unexpected predictions with humans.
