Search Results for author:
Found 4 papers, 4 papers with code
FastVLM: Efficient Vision Encoding for Vision Language Models
At different operational resolutions, the vision encoder of a VLM can be optimized along two axes: reducing encoding latency and minimizing the number of visual tokens passed to the LLM, thereby lowering overall latency.
HUGS: Human Gaussian Splats
We achieve state-of-the-art rendering quality with a rendering speed of 60 FPS while being ~100x faster to train over previous work.
FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization
To this end, we introduce a novel token mixing operator, RepMixer, a building block of FastViT, that uses structural reparameterization to lower the memory access cost by removing skip-connections in the network.
Ranked #2 on
Semantic Segmentation
on ADE20K
(Mean IoU (class) metric)
MobileOne: An Improved One millisecond Mobile Backbone
Furthermore, we show that our model generalizes to multiple tasks - image classification, object detection, and semantic segmentation with significant improvements in latency and accuracy as compared to existing efficient architectures when deployed on a mobile device.
Ranked #3 on
Image Classification
on ImageNet
(Number of params metric)
