VisFocus: Prompt-Guided Vision Encoders for OCR-Free Dense Document Understanding

no code implementations • 17 Jul 2024 • Ofir Abramovich, Niv Nayman, Sharon Fogel, Inbal Lavi, Ron Litman, Shahar Tsiper, Royee Tichauer, Srikar Appalaraju, Shai Mazor, R. Manmatha

In recent years, notable advancements have been made in the domain of visual document understanding, with the prevailing architecture comprising a cascade of vision and language models.

document understanding Optical Character Recognition (OCR)

CLIPTER: Looking at the Bigger Picture in Scene Text Recognition

no code implementations • ICCV 2023 • Aviad Aberdam, David Bensaïd, Alona Golts, Roy Ganz, Oren Nuriel, Royee Tichauer, Shai Mazor, Ron Litman

Reading text in real-world scenarios often requires understanding the context surrounding it, especially when dealing with poor-quality text.

Language Modelling Scene Text Recognition