Parameter-Efficient Fine-Tuning with Discrete Fourier Transform

chaos96/fourierft 5 May 2024

Low-rank adaptation~(LoRA) has recently gained much interest in fine-tuning foundation models.

Image Classification Natural Language Understanding +1

45
0.36 stars / hour

MRSegmentator: Robust Multi-Modality Segmentation of 40 Classes in MRI and CT Sequences

hhaentze/mrsegmentator 10 May 2024

Results: The model showcased high accuracy in segmenting well-defined organs, achieving Dice Similarity Coefficient (DSC) scores of 0. 97 for the right and left lungs, and 0. 95 for the heart.

Model Optimization Organ Segmentation +2

48
0.36 stars / hour

Rewrite the Stars

ma-xu/rewrite-the-stars 29 Mar 2024

Recent studies have drawn attention to the untapped potential of the "star operation" (element-wise multiplication) in network design.

135
0.35 stars / hour

4D Panoptic Scene Graph Generation

jingkang50/psg4d 16 May 2024

To facilitate research in this new area, we build a richly annotated PSG-4D dataset consisting of 3K RGB-D videos with a total of 1M frames, each of which is labeled with 4D panoptic segmentation masks as well as fine-grained, dynamic scene graphs.

4D Panoptic Segmentation Graph Generation +5

33
0.34 stars / hour

OpenProteinSet: Training data for structural biology at scale

aqlaboratory/openfold NeurIPS 2023

Multiple sequence alignments (MSAs) of proteins encode rich biological information and have been workhorses in bioinformatic methods for tasks like protein design and protein structure prediction for decades.

Protein Design Protein Structure Prediction

2,508
0.33 stars / hour

Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models

assafelovic/gpt-researcher 22 Feb 2024

We study how to apply large language models to write grounded and organized long-form articles from scratch, with comparable breadth and depth to Wikipedia pages.

Retrieval

10,839
0.33 stars / hour

Spectrally Pruned Gaussian Fields with Neural Compensation

runyiyang/sundae 1 May 2024

However, this comes with high memory consumption, e. g., a well-trained Gaussian field may utilize three million Gaussian primitives and over 700 MB of memory.

136
0.32 stars / hour

LeMeViT: Efficient Vision Transformer with Learnable Meta Tokens for Remote Sensing Image Interpretation

vitae-transformer/lemevit 16 May 2024

Experimental results in classification and dense prediction tasks show that LeMeViT has a significant $1. 7 \times$ speedup, fewer parameters, and competitive performance compared to the baseline models, and achieves a better trade-off between efficiency and performance.

23
0.32 stars / hour

MS MARCO Web Search: a Large-scale Information-rich Web Dataset with Millions of Real Click Labels

microsoft/ms-marco-web-search 13 May 2024

Recent breakthroughs in large models have highlighted the critical significance of data scale, labels and modals.

Information Retrieval Retrieval

240
0.30 stars / hour

DiverGen: Improving Instance Segmentation by Learning Wider Data Distribution with More Diverse Generative Data

aim-uofa/DiverGen 16 May 2024

Instance segmentation is data-hungry, and as model capacity increases, data scale becomes crucial for improving the accuracy.

Data Augmentation Instance Segmentation +2

14
0.30 stars / hour