Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffs

no code implementations • 10 Mar 2021 • Solon Barocas, Anhong Guo, Ece Kamar, Jacquelyn Krones, Meredith Ringel Morris, Jennifer Wortman Vaughan, Duncan Wadsworth, Hanna Wallach

Disaggregated evaluations of AI systems, in which system performance is assessed and reported separately for different groups of people, are conceptually simple.

StateLens: A Reverse Engineering Solution for Making Existing Dynamic Touchscreens Accessible

1 code implementation • 20 Aug 2019 • Anhong Guo, Junhan Kong, Michael Rivera, Frank F. Xu, Jeffrey P. Bigham

Second, using the state diagrams, StateLens automatically generates conversational agents to guide blind users through specifying the tasks that the interface can perform, allowing the StateLens iOS application to provide interactive guidance and feedback so that blind users can access the interface.

Toward Fairness in AI for People with Disabilities: A Research Roadmap

no code implementations • 4 Jul 2019 • Anhong Guo, Ece Kamar, Jennifer Wortman Vaughan, Hanna Wallach, Meredith Ringel Morris

AI technologies have the potential to dramatically impact the lives of people with disabilities (PWD).

Fairness speech-recognition +1

VizWiz Grand Challenge: Answering Visual Questions from Blind People

1 code implementation • CVPR 2018 • Danna Gurari, Qing Li, Abigale J. Stangl, Anhong Guo, Chi Lin, Kristen Grauman, Jiebo Luo, Jeffrey P. Bigham

The study of algorithms to automatically answer visual questions currently is motivated by visual question answering (VQA) datasets constructed in artificial VQA settings.

Question Answering Visual Question Answering