MarkushGrapher: Joint Visual and Textual Recognition of Markush Structures

1 code implementation • 20 Mar 2025 • Lucas Morin, Valéry Weber, Ahmed Nassar, Gerhard Ingmar Meijer, Luc van Gool, Yawei Li, Peter Staar

In this work, we present MarkushGrapher, a multi-modal approach for recognizing Markush structures in documents.

Synthetic Data Generation

SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion

no code implementations • 14 Mar 2025 • Ahmed Nassar, Andres Marafioti, Matteo Omenetti, Maksym Lysak, Nikolaos Livathinos, Christoph Auer, Lucas Morin, Rafael Teixeira de Lima, Yusik Kim, A. Said Gurbuz, Michele Dolfi, Miquel Farré, Peter W. J. Staar

We introduce SmolDocling, an ultra-compact vision-language model targeting end-to-end document conversion.

Language Modeling Language Modelling

Docling: An Efficient Open-Source Toolkit for AI-driven Document Conversion

no code implementations • 27 Jan 2025 • Nikolaos Livathinos, Christoph Auer, Maksym Lysak, Ahmed Nassar, Michele Dolfi, Panos Vagenas, Cesar Berrospi Ramis, Matteo Omenetti, Kasper Dinkla, Yusik Kim, Shubham Gupta, Rafael Teixeira de Lima, Valery Weber, Lucas Morin, Ingmar Meijer, Viktor Kuropiatnyk, Peter W. J. Staar

We introduce Docling, an easy-to-use, self-contained, MIT-licensed, open-source toolkit for document conversion, that can parse several types of popular document formats into a unified, richly structured representation.

Docling Technical Report

3 code implementations • 19 Aug 2024 • Christoph Auer, Maksym Lysak, Ahmed Nassar, Michele Dolfi, Nikolaos Livathinos, Panos Vagenas, Cesar Berrospi Ramis, Matteo Omenetti, Fabian Lindlbauer, Kasper Dinkla, Lokesh Mishra, Yusik Kim, Shubham Gupta, Rafael Teixeira de Lima, Valery Weber, Lucas Morin, Ingmar Meijer, Viktor Kuropiatnyk, Peter W. J. Staar

This technical report introduces Docling, an easy to use, self-contained, MIT-licensed open-source package for PDF document conversion.

ESG Accountability Made Easy: DocQA at Your Service

no code implementations • 30 Nov 2023 • Lokesh Mishra, Cesar Berrospi, Kasper Dinkla, Diego Antognini, Francesco Fusco, Benedikt Bothur, Maksym Lysak, Nikolaos Livathinos, Ahmed Nassar, Panagiotis Vagenas, Lucas Morin, Christoph Auer, Michele Dolfi, Peter Staar

We present Deep Search DocQA.

Question Answering

MolGrapher: Graph-based Visual Recognition of Chemical Structures

1 code implementation • ICCV 2023 • Lucas Morin, Martin Danelljan, Maria Isabel Agea, Ahmed Nassar, Valery Weber, Ingmar Meijer, Peter Staar, Fisher Yu

In addition, we introduce a large-scale benchmark of annotated real molecule images, USPTO-30K, to spur research on this critical topic.

Diversity Graph Neural Network