Search Results for author: Mathew Monfort

Found 11 papers, 6 papers with code

Precise Model Benchmarking with Only a Few Observations

no code implementations7 Oct 2024 Riccardo Fogliato, Pratik Patil, Nil-Jana Akpinar, Mathew Monfort

How can we precisely estimate a large language model's (LLM) accuracy on questions belonging to a specific topic within a larger question-answering dataset?

Benchmarking model +2

A Framework for Efficient Model Evaluation through Stratification, Sampling, and Estimation

1 code implementation11 Jun 2024 Riccardo Fogliato, Pratik Patil, Mathew Monfort, Pietro Perona

Model performance evaluation is a critical and expensive task in machine learning and computer vision.

Spoken Moments: Learning Joint Audio-Visual Representations from Video Descriptions

no code implementations CVPR 2021 Mathew Monfort, SouYoung Jin, Alexander Liu, David Harwath, Rogerio Feris, James Glass, Aude Oliva

With this in mind, the descriptions people generate for videos of different dynamic events can greatly improve our understanding of the key information of interest in each video.

Contrastive Learning Retrieval +1

Reasoning About Human-Object Interactions Through Dual Attention Networks

no code implementations ICCV 2019 Tete Xiao, Quanfu Fan, Dan Gutfreund, Mathew Monfort, Aude Oliva, Bolei Zhou

The model not only finds when an action is happening and which object is being manipulated, but also identifies which part of the object is being interacted with.

Human-Object Interaction Detection Object

Multi-Agent Tensor Fusion for Contextual Trajectory Prediction

1 code implementation CVPR 2019 Tianyang Zhao, Yifei Xu, Mathew Monfort, Wongun Choi, Chris Baker, Yibiao Zhao, Yizhou Wang, Ying Nian Wu

Specifically, the model encodes multiple agents' past trajectories and the scene context into a Multi-Agent Tensor, then applies convolutional fusion to capture multiagent interactions while retaining the spatial structure of agents and the scene context.

Autonomous Driving Prediction +1

Moments in Time Dataset: one million videos for event understanding

4 code implementations9 Jan 2018 Mathew Monfort, Alex Andonian, Bolei Zhou, Kandan Ramakrishnan, Sarah Adel Bargal, Tom Yan, Lisa Brown, Quanfu Fan, Dan Gutfruend, Carl Vondrick, Aude Oliva

We present the Moments in Time Dataset, a large-scale human-annotated collection of one million short videos corresponding to dynamic events unfolding within three seconds.

Action Recognition Diversity +2

End to End Learning for Self-Driving Cars

113 code implementations25 Apr 2016 Mariusz Bojarski, Davide Del Testa, Daniel Dworakowski, Bernhard Firner, Beat Flepp, Prasoon Goyal, Lawrence D. Jackel, Mathew Monfort, Urs Muller, Jiakai Zhang, Xin Zhang, Jake Zhao, Karol Zieba

The system automatically learns internal representations of the necessary processing steps such as detecting useful road features with only the human steering angle as the training signal.

Lane Detection Self-Driving Cars

Softstar: Heuristic-Guided Probabilistic Inference

no code implementations NeurIPS 2015 Mathew Monfort, Brenden M. Lake, Brian Ziebart, Patrick Lucey, Josh Tenenbaum

Recent machine learning methods for sequential behavior prediction estimate the motives of behavior rather than the behavior itself.

BIG-bench Machine Learning Prediction

Cannot find the paper you are looking for? You can Submit a new open access paper.