Search Results for author: James Wexler

Found 13 papers, 5 papers with code

ConstitutionalExperts: Training a Mixture of Principle-based Prompts

no code implementations7 Mar 2024 Savvas Petridis, Ben Wedin, Ann Yuan, James Wexler, Nithum Thain

We also show that we can improve overall performance by learning unique prompts for different semantic regions of the training data and using a mixture-of-experts (MoE) architecture to route inputs at inference time.

Automatic Histograms: Leveraging Language Models for Text Dataset Exploration

no code implementations21 Feb 2024 Emily Reif, Crystal Qian, James Wexler, Minsuk Kahng

Making sense of unstructured text datasets is perennially difficult, yet increasingly relevant with Large Language Models.

LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language Models

no code implementations16 Feb 2024 Minsuk Kahng, Ian Tenney, Mahima Pushkarna, Michael Xieyang Liu, James Wexler, Emily Reif, Krystal Kallarackal, Minsuk Chang, Michael Terry, Lucas Dixon

Automatic side-by-side evaluation has emerged as a promising approach to evaluating the quality of responses from large language models (LLMs).

ConstitutionMaker: Interactively Critiquing Large Language Models by Converting Feedback into Principles

no code implementations24 Oct 2023 Savvas Petridis, Ben Wedin, James Wexler, Aaron Donsbach, Mahima Pushkarna, Nitesh Goyal, Carrie J. Cai, Michael Terry

Inspired by these findings, we developed ConstitutionMaker, an interactive tool for converting user feedback into principles, to steer LLM-based chatbots.

Chatbot Language Modelling +2

Analyzing a Caching Model

no code implementations13 Dec 2021 Leon Sixt, Evan Zheran Liu, Marie Pellat, James Wexler, Milad Hashemi, Been Kim, Martin Maas

Machine Learning has been successfully applied in systems applications such as memory prefetching and caching, where learned models have been shown to outperform heuristics.

Best of both worlds: local and global explanations with human-understandable concepts

no code implementations16 Jun 2021 Jessica Schrouff, Sebastien Baur, Shaobo Hou, Diana Mincu, Eric Loreaux, Ralph Blanes, James Wexler, Alan Karthikesalingam, Been Kim

While there are many methods focused on either one, few frameworks can provide both local and global explanations in a consistent manner.

The Bach Doodle: Approachable music composition with machine learning at scale

no code implementations14 Jul 2019 Cheng-Zhi Anna Huang, Curtis Hawthorne, Adam Roberts, Monica Dinculescu, James Wexler, Leon Hong, Jacob Howcroft

To make music composition more approachable, we designed the first AI-powered Google Doodle, the Bach Doodle, where users can create their own melody and have it harmonized by a machine learning model Coconet (Huang et al., 2017) in the style of Bach.

BIG-bench Machine Learning Quantization

The What-If Tool: Interactive Probing of Machine Learning Models

1 code implementation9 Jul 2019 James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Viegas, Jimbo Wilson

A key challenge in developing and deploying Machine Learning (ML) systems is understanding their performance across a wide range of inputs.

BIG-bench Machine Learning Fairness

Towards Automatic Concept-based Explanations

2 code implementations NeurIPS 2019 Amirata Ghorbani, James Wexler, James Zou, Been Kim

Interpretability has become an important topic of research as more machine learning (ML) models are deployed and widely used to make important decisions.

Feature Importance

ClinicalVis: Supporting Clinical Task-Focused Design Evaluation

1 code implementation13 Oct 2018 Marzyeh Ghassemi, Mahima Pushkarna, James Wexler, Jesse Johnson, Paul Varghese

Making decisions about what clinical tasks to prepare for is multi-factored, and especially challenging in intensive care environments where resources must be balanced with patient needs.

Human-Computer Interaction

Cannot find the paper you are looking for? You can Submit a new open access paper.