Search Results for author:
Found 8 papers, 0 papers with code
BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebooks
We present this workflow in BISCUIT, an extension for JupyterLab that provides users with ephemeral UIs generated by LLMs based on the context of their code and intentions, scaffolding users to understand, guide, and explore with LLM-generated code.
Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs
For model evaluation, we establish a comprehensive benchmark encompassing all the aforementioned tasks.
ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations
Multimodal Vision-Language Models (VLMs) enable powerful applications from their fused understanding of images and language, but many perform poorly on UI tasks due to the lack of UI training data.
AXNav: Replaying Accessibility Tests from Natural Language
Recently, Large Language Models (LLMs) have been used for a variety of tasks including automation of UIs, however to our knowledge no one has yet explored their use in controlling assistive technologies for the purposes of supporting accessibility testing.
Sketch-based Creativity Support Tools using Deep Learning
Sketching is a natural and effective visual communication medium commonly used in creative processes.
A Computational Method for Evaluating UI Patterns
UI design languages, such as Google's Material Design, make applications both easier to develop and easier to learn by providing a set of standard UI components.
Home Location Identification of Twitter Users
We present a new algorithm for inferring the home location of Twitter users at different granularities, including city, state, time zone or geographic region, using the content of users tweets and their tweeting behavior.
Why Are You More Engaged? Predicting Social Engagement from Word Use
We present a study to analyze how word use can predict social engagement behaviors such as replies and retweets in Twitter.
