Search Results for author: Iddo Drori

Found 34 papers, 14 papers with code

Exploring the MIT Mathematics and EECS Curriculum Using Large Language Models

no code implementations15 Jun 2023 Sarah J. Zhang, Samuel Florin, Ariel N. Lee, Eamon Niknafs, Andrei Marginean, Annie Wang, Keith Tyser, Zad Chin, Yann Hicke, Nikhil Singh, Madeleine Udell, Yoon Kim, Tonio Buonassisi, Armando Solar-Lezama, Iddo Drori

We curate a comprehensive dataset of 4, 550 questions and solutions from problem sets, midterm exams, and final exams across all MIT Mathematics and Electrical Engineering and Computer Science (EECS) courses required for obtaining a degree.

Electrical Engineering Few-Shot Learning +3

Human Evaluation of Text-to-Image Models on a Multi-Task Benchmark

no code implementations22 Nov 2022 Vitali Petsiuk, Alexander E. Siemenn, Saisamrit Surbehera, Zad Chin, Keith Tyser, Gregory Hunter, Arvind Raghavan, Yann Hicke, Bryan A. Plummer, Ori Kerret, Tonio Buonassisi, Kate Saenko, Armando Solar-Lezama, Iddo Drori

For example, asking a model to generate a varying number of the same object to measure its ability to count or providing a text prompt with several objects that each have a different attribute to identify its ability to match objects and attributes correctly.

Attribute Text-to-Image Generation

Solving Linear Algebra by Program Synthesis

no code implementations16 Nov 2021 Iddo Drori, Nakul Verma

We solve MIT's Linear Algebra 18. 06 course and Columbia University's Computational Linear Algebra COMS3251 courses with perfect accuracy by interactive program synthesis.

Math Program Synthesis +1

Solving Probability and Statistics Problems by Program Synthesis

no code implementations16 Nov 2021 Leonard Tang, Elizabeth Ke, Nikhil Singh, Nakul Verma, Iddo Drori

Our work is the first to introduce a new dataset of university-level probability and statistics problems and solve these problems in a scalable fashion using the program synthesis capabilities of large language models.

Program Synthesis Prompt Engineering

AlphaD3M: Machine Learning Pipeline Synthesis

no code implementations3 Nov 2021 Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni de Paula Lourenco, Jorge Piazentin Ono, Kyunghyun Cho, Claudio Silva, Juliana Freire

We introduce AlphaD3M, an automatic machine learning (AutoML) system based on meta reinforcement learning using sequence models with self play.

AutoML BIG-bench Machine Learning +3

Predicting Critical Biogeochemistry of the Southern Ocean for Climate Monitoring

no code implementations30 Oct 2021 Ellen Park, Jae Deok Kim, Nadege Aoki, Yumeng Melody Cao, Yamin Arefeen, Matthew Beveridge, David Nicholson, Iddo Drori

We trained our neural networks on observations from the Global Ocean Ship-Based Hydrographic Investigations Program (GO-SHIP) and use dropout regularization to provide uncertainty bounds around our predicted values.

Predicting Atlantic Multidecadal Variability

no code implementations29 Oct 2021 Glenn Liu, Peidong Wang, Matthew Beveridge, Young-Oh Kwon, Iddo Drori

Atlantic Multidecadal Variability (AMV) describes variations of North Atlantic sea surface temperature with a typical cycle of between 60 and 70 years.

Solving the Families In the Wild Kinship Verification Challenge by Program Synthesis

no code implementations13 Oct 2021 Junyi Huang, Maxwell Benjamin Strome, Ian Jenkins, Parker Williams, Bo Feng, Yaning Wang, Roman Wang, Vaibhav Bagri, Newman Cheng, Iddo Drori

Kinship verification is the task of determining whether a parent-child, sibling, or grandparent-grandchild relationship exists between two people and is important in social media applications, forensic investigations, finding missing children, and reuniting families.

Kinship Verification Program Synthesis

Pedestrian Wind Factor Estimation in Complex Urban Environments

no code implementations6 Oct 2021 Sarah Mokhtar, Matthew Beveridge, Yumeng Cao, Iddo Drori

Urban planners and policy makers face the challenge of creating livable and enjoyable cities for larger populations in much denser urban conditions.

Generative Adversarial Network

Image2Lego: Customized LEGO Set Generation from Images

no code implementations19 Aug 2021 Kyle Lennon, Katharina Fransen, Alexander O'Brien, Yumeng Cao, Matthew Beveridge, Yamin Arefeen, Nikhil Singh, Iddo Drori

In order to demonstrate the broad applicability of our system, we generate step-by-step building instructions and animations for LEGO models of objects and human faces.

Solving Machine Learning Problems

1 code implementation2 Jul 2021 Sunny Tran, Pranav Krishna, Ishan Pakuwal, Prabhakar Kafle, Nikhil Singh, Jayson Lynch, Iddo Drori

Our system demonstrates an overall accuracy of 96% for open-response questions and 97% for multiple-choice questions, compared with MIT students' average of 93%, achieving grade A performance in the course, all in real-time.

BIG-bench Machine Learning Data Augmentation +2

Privileged Zero-Shot AutoML

no code implementations25 Jun 2021 Nikhil Singh, Brandon Kates, Jeff Mentch, Anant Kharkar, Madeleine Udell, Iddo Drori

This work improves the quality of automated machine learning (AutoML) systems by using dataset and function descriptions while significantly decreasing computation time from minutes to milliseconds by using a zero-shot approach.

AutoML BIG-bench Machine Learning +1

Online Preconditioning of Experimental Inkjet Hardware by Bayesian Optimization in Loop

no code implementations6 May 2021 Alexander E. Siemenn, Matthew Beveridge, Tonio Buonassisi, Iddo Drori

Thus, in this work, we develop a computer vision-driven Bayesian optimization framework for optimizing the deposited droplet structures from an inkjet printer such that it is tuned to perform high-throughput experimentation on semiconductor materials.

Bayesian Optimization

Image2Reverb: Cross-Modal Reverb Impulse Response Synthesis

1 code implementation ICCV 2021 Nikhil Singh, Jeff Mentch, Jerry Ng, Matthew Beveridge, Iddo Drori

Measuring the acoustic characteristics of a space is often done by capturing its impulse response (IR), a representation of how a full-range stimulus sound excites it.

Real-Time AutoML

no code implementations1 Jan 2021 Iddo Drori, Brandon Kates, Anant Kharkar, Lu Liu, Qiang Ma, Jonah Deykin, Nihar Sidhu, Madeleine Udell

We train a graph neural network in which each node represents a dataset to predict the best machine learning pipeline for a new test dataset.

AutoML BIG-bench Machine Learning +1

High Quality Real-Time Structured Debate Generation

1 code implementation1 Dec 2020 Eric Bolton, Alex Calderwood, Niles Christensen, Jerome Kafrouni, Iddo Drori

Automatically generating debates is a challenging task that requires an understanding of arguments and how to negate or support them.

Sentence Sentence Embedding +2

GalaxyTSP: A New Billion-Node Benchmark for TSP

no code implementations NeurIPS Workshop LMCA 2020 Iddo Drori, Brandon J Kates, William R. Sickinger, Anant Girish Kharkar, Brenda Dietrich, Avi Shporer, Madeleine Udell

We approximate a Traveling Salesman Problem (TSP) three orders of magnitude larger than the largest known benchmark, increasing the number of nodes from millions to billions.

Scheduling Traveling Salesman Problem

Vehicle Trajectory Prediction by Transfer Learning of Semi-Supervised Models

no code implementations14 Jul 2020 Nick Lamm, Shashank Jaiprakash, Malavika Srikanth, Iddo Drori

In this work we show that semi-supervised models for vehicle trajectory prediction significantly improve performance over supervised models on state-of-the-art real-world benchmarks.

Contrastive Learning Trajectory Prediction +1

Combinatorial Optimization by Graph Pointer Networks and Hierarchical Reinforcement Learning

2 code implementations12 Nov 2019 Qiang Ma, Suwen Ge, Danyang He, Darshan Thaker, Iddo Drori

Furthermore, to approximate solutions to constrained combinatorial optimization problems such as the TSP with time windows, we train hierarchical GPNs (HGPNs) using RL, which learns a hierarchical policy to find an optimal city permutation under constraints.

Combinatorial Optimization Graph Embedding +4

Accurate Protein Structure Prediction by Embeddings and Deep Learning Representations

3 code implementations9 Nov 2019 Iddo Drori, Darshan Thaker, Arjun Srivatsa, Daniel Jeong, Yueqi Wang, Linyong Nan, Fan Wu, Dimitri Leggas, Jinhao Lei, Weiyi Lu, Weilong Fu, Yuan Gao, Sashank Karri, Anand Kannan, Antonio Moretti, Mohammed AlQuraishi, Chen Keasar, Itsik Pe'er

Our dataset consists of amino acid sequences, Q8 secondary structures, position specific scoring matrices, multiple sequence alignment co-evolutionary features, backbone atom distance matrices, torsion angles, and 3D coordinates.

Multiple Sequence Alignment Protein Structure Prediction

Visual Natural Language Query Auto-Completion for Estimating Instance Probabilities

1 code implementation10 Oct 2019 Samuel Sharpe, Jin Yan, Fan Wu, Iddo Drori

Given the complete query, we fine tune a BERT embedding for estimating probabilities of a broad set of instances.

Prose for a Painting

1 code implementation8 Oct 2019 Prerna Kashyap, Samrat Phatale, Iddo Drori

Painting captions are often dry and simplistic which motivates us to describe a painting creatively in the style of Shakespearean prose.

Style Transfer

AutoML using Metadata Language Embeddings

2 code implementations8 Oct 2019 Iddo Drori, Lu Liu, Yi Nian, Sharath C. Koorathota, Jie S. Li, Antonio Khalil Moretti, Juliana Freire, Madeleine Udell

We use these embeddings in a neural architecture to learn the distance between best-performing pipelines.

AutoML

Particle Smoothing Variational Objectives

1 code implementation20 Sep 2019 Antonio Khalil Moretti, Zizhao Wang, Luhuan Wu, Iddo Drori, Itsik Pe'er

We apply SVO to three nonlinear latent dynamics tasks and provide statistics to rigorously quantify the predictions of filtered and smoothed objectives.

Cannot find the paper you are looking for? You can Submit a new open access paper.