Scaling Laws with Hidden Structure

1 code implementation • 2 Nov 2024 • Charles Arnal, Clement Berenfeld, Simon Rosenberg, Vivien Cabannes

Statistical learning in high-dimensional spaces is challenging without a strong underlying data structure.

Synthetic Multimodal Question Generation

no code implementations • 2 Jul 2024 • Ian Wu, Sravan Jayanthi, Vijay Viswanathan, Simon Rosenberg, Sina Pakazad, Tongshuang Wu, Graham Neubig

We find that the quality of SMMQG-generated synthetic data is on par with the quality of the crowdsourced benchmark MMQA and that downstream evaluation results using both datasets strongly concur.

Language Modelling Large Language Model +5