PerOS: Personalized Self-Adapting Operating Systems in the Cloud

no code implementations • 26 Mar 2024 • Hongyu Hè

Operating systems (OSes) are foundational to computer systems, managing hardware resources and ensuring secure environments for diverse applications.

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

no code implementations • 14 Mar 2024 • Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier, Sam Dodge, BoWen Zhang, Philipp Dufter, Dhruti Shah, Xianzhi Du, Futang Peng, Floris Weers, Anton Belyi, Haotian Zhang, Karanjeet Singh, Doug Kang, Ankur Jain, Hongyu Hè, Max Schwarzer, Tom Gunter, Xiang Kong, Aonan Zhang, Jianyu Wang, Chong Wang, Nan Du, Tao Lei, Sam Wiseman, Guoli Yin, Mark Lee, ZiRui Wang, Ruoming Pang, Peter Grasch, Alexander Toshev, Yinfei Yang

Through careful and comprehensive ablations of the image encoder, the vision language connector, and various pre-training data choices, we identified several crucial design lessons.

In-Context Learning Visual Question Answering

A Unified View of Long-Sequence Models towards Modeling Million-Scale Dependencies

no code implementations • 13 Feb 2023 • Hongyu Hè, Marko Kabic

However, Transformers fall short in learning long-range dependencies mainly due to the quadratic complexity scaled with context length, in terms of both time and space.

Image Classification