Search Results for author: Faria Huq

Found 5 papers, 2 papers with code

CowPilot: A Framework for Autonomous and Human-Agent Collaborative Web Navigation

no code implementations28 Jan 2025 Faria Huq, Zora Zhiruo Wang, Frank F. Xu, Tianyue Ou, Shuyan Zhou, Jeffrey P. Bigham, Graham Neubig

CowPilot reduces the number of steps humans need to perform by allowing agents to propose next steps, while users are able to pause, reject, or take alternative actions.

DreamStruct: Understanding Slides and User Interfaces via Synthetic Data Generation

1 code implementation30 Sep 2024 Yi-Hao Peng, Faria Huq, Yue Jiang, Jason Wu, Amanda Xin Yue Li, Jeffrey Bigham, Amy Pavel

Enabling machines to understand structured visuals like slides and user interfaces is essential for making them accessible to people with disabilities.

Code Generation Synthetic Data Generation

"What's important here?": Opportunities and Challenges of Using LLMs in Retrieving Information from Web Interfaces

no code implementations11 Dec 2023 Faria Huq, Jeffrey P. Bigham, Nikolas Martelaro

Large language models (LLMs) that have been trained on a corpus that includes large amount of code exhibit a remarkable ability to understand HTML code.

Autonomous Web Navigation

Riemannian Functional Map Synchronization for Probabilistic Partial Correspondence in Shape Networks

no code implementations29 Nov 2021 Faria Huq, Adrish Dey, Sahra Yusuf, Dena Bazazian, Tolga Birdal, Nina Miolane

Our experiments demonstrate that constraining the synchronization on the Riemannian manifold $SO(n)$ improves the estimation of the functional maps, while our RLFM sampler provides for the first time an uncertainty quantification of the results.

Graph Matching Uncertainty Quantification

Static and Animated 3D Scene Generation from Free-form Text Descriptions

1 code implementation4 Oct 2020 Faria Huq, Nafees Ahmed, Anindya Iqbal

As the choice of words and syntax vary while preparing a textual description, it is challenging for the system to reliably produce a consistently desirable output from different forms of language input.

Decoder Form +3

Cannot find the paper you are looking for? You can Submit a new open access paper.