1 code implementation • 28 Nov 2023 • Keunwoo Peter Yu, Zheyuan Zhang, Fengyuan Hu, Shane Storks, Joyce Chai
Our results, analysis, and \eilev{}-trained models yield numerous insights about the emergence of in-context learning over video and text, creating a foundation for future work to optimize and scale VLMs for open-domain video understanding and reasoning.
1 code implementation • 1 Nov 2023 • Yuwei Bao, Keunwoo Peter Yu, Yichi Zhang, Shane Storks, Itamar Bar-Yossef, Alexander De La Iglesia, Megan Su, Xiao Lin Zheng, Joyce Chai
Despite tremendous advances in AI, it remains a significant challenge to develop interactive task guidance systems that can offer situated, personalized guidance and assist humans in various tasks.
1 code implementation • 24 Oct 2023 • Zheyuan Zhang, Shane Storks, Fengyuan Hu, Sungryull Sohn, Moontae Lee, Honglak Lee, Joyce Chai
We incorporate these interlinked dual processes in fine-tuning and in-context learning with PLMs, applying them to two language understanding tasks that require coherent physical commonsense reasoning.
1 code implementation • 28 May 2023 • Xiaoyang Hu, Shane Storks, Richard L. Lewis, Joyce Chai
Analogical reasoning is a fundamental capacity of human cognition that allows us to reason abstractly about novel situations by relating them to past experiences.
3 code implementations • 26 May 2023 • Shane Storks, Keunwoo Peter Yu, Ziqiao Ma, Joyce Chai
As natural language processing (NLP) has recently seen an unprecedented level of excitement, and more people are eager to enter the field, it is unclear whether current research reproducibility efforts are sufficient for this group of beginners to apply the latest developments.
1 code implementation • 22 Oct 2022 • Yichi Zhang, Jianing Yang, Jiayi Pan, Shane Storks, Nikhil Devraj, Ziqiao Ma, Keunwoo Peter Yu, Yuwei Bao, Joyce Chai
These reactive agents are insufficient for long-horizon complex tasks.
no code implementations • 4 May 2022 • Shane Storks, Keunwoo Peter Yu, Joyce Chai
As NLP research attracts public attention and excitement, it becomes increasingly important for it to be accessible to a broad audience.
no code implementations • AAAI Workshop CLeaR 2022 • Shane Storks, Qiaozi Gao, Aishwarya Reganti, Govind Thattai
Language-enabled AI systems can answer complex, multi-hop questions to high accuracy, but supporting answers with evidence is a more challenging task which is important for the transparency and trustworthiness to users.
1 code implementation • Findings (EMNLP) 2021 • Shane Storks, Qiaozi Gao, Yichi Zhang, Joyce Chai
However, evaluations only based on end task performance shed little light on machines' true ability in language understanding and reasoning.
1 code implementation • Findings (EMNLP) 2021 • Shane Storks, Joyce Chai
As large-scale, pre-trained language models achieve human-level and superhuman accuracy on existing language understanding tasks, statistical bias in benchmark data and probing studies have recently called into question their true capabilities.
no code implementations • 9 Jan 2021 • Shane Storks, Qiaozi Gao, Govind Thattai, Gokhan Tur
Embodied instruction following is a challenging problem requiring an agent to infer a sequence of primitive actions to achieve a goal environment state from complex language and visual inputs.
1 code implementation • 2 Apr 2019 • Shane Storks, Qiaozi Gao, Joyce Y. Chai
In the NLP community, recent years have seen a surge of research activities that address machines' ability to perform deep language understanding which goes beyond what is explicitly stated in text, rather relying on reasoning and knowledge of the world.