Search Results for author: Manuj Malik

Found 2 papers, 0 papers with code

Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answering

no code implementations17 Feb 2024 Pragya Srivastava, Manuj Malik, Vivek Gupta, Tanuja Ganu, Dan Roth

Large Language Models (LLMs), excel in natural language understanding, but their capability for complex mathematical reasoning with an amalgamation of structured tables and unstructured text is uncertain.

Arithmetic Reasoning Mathematical Reasoning +2

Controlling for Stereotypes in Multimodal Language Model Evaluation

no code implementations3 Feb 2023 Manuj Malik, Richard Johansson

We propose a methodology and design two benchmark sets for measuring to what extent language-and-vision language models use the visual signal in the presence or absence of stereotypes.

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.