CompactifAI: Extreme Compression of Large Language Models using Quantum-Inspired Tensor Networks

no code implementations • 25 Jan 2024 • Andrei Tomut, Saeed S. Jahromi, Sukhbinder Singh, Faysal Ishtiaq, Cesar Muñoz, Prabdeep Singh Bajaj, Ali Elborady, Gianni Del Bimbo, Mehrazin Alizadeh, David Montero, Pablo Martin-Ramiro, Muhammad Ibrahim, Oussama Tahiri Alaoui, John Malcolm, Samuel Mugel, Roman Orus

Large Language Models (LLMs) such as ChatGPT and LlaMA are advancing rapidly in generative Artificial Intelligence (AI), but their immense size poses significant challenges, such as huge training and inference costs, substantial energy demands, and limitations for on-site deployment.

Model Compression Quantization +1

Searching for Multiple Populations in Ruprecht 106

no code implementations • 11 Feb 2021 • Heinz Frelijj, Sandro Villanova, Cesar Muñoz, José Fernández-Trincado

More than a decade has passed since the definition of Globular Cluster (GC) changed, and now we know that they host Multiple Populations (MPs).

Astrophysics of Galaxies