Trending Research
Depth Pro: Sharp Monocular Metric Depth in Less Than a Second
We present a foundation model for zero-shot metric monocular depth estimation.
Posterior-Mean Rectified Flow: Towards Minimum MSE Photo-Realistic Image Restoration
ohayonguy/PMRF
•
•
Photo-realistic image restoration algorithms are typically evaluated by distortion measures (e. g., PSNR, SSIM) and by perceptual quality measures (e. g., FID, NIQE), where the desire is to attain the lowest possible distortion without compromising on perceptual quality.
Ranked #1 on
Blind Face Restoration
on CelebA-Test
(FID metric)
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
microsoft/vptq
•
•
Due to the redundancy in LLM weights, recent research has focused on pushing weight-only quantization to extremely low-bit (even down to 2 bits).
"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models
We hope that our study can facilitate the research community and LLM vendors in promoting safer and regulated LLMs.
Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers
liruiw/HPT
•
•
Previous robot learning methods often collect data to train with one specific embodiment for one task, which is expensive and prone to overfitting.
LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
thudm/longwriter
•
•
By incorporating this dataset into model training, we successfully scale the output length of existing models to over 10, 000 words while maintaining output quality.
A Multi-Level Superoptimizer for Tensor Programs
We introduce Mirage, the first multi-level superoptimizer for tensor programs.
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration
Although quantization has proven to be an effective method for accelerating model inference, existing quantization methods primarily focus on optimizing the linear layer.
LLaMA-Omni: Seamless Speech Interaction with Large Language Models
We build our model based on the latest Llama-3. 1-8B-Instruct model.
Diffusion Models are Evolutionary Algorithms
Zhangyanbo/diffusion-evolution
•
•
In a convergence of machine learning and biology, we reveal that diffusion models are evolutionary algorithms.
