Search Results for author:
Found 5 papers, 1 papers with code
Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers
Vid2Robot uses cross-attention transformer layers between video features and the current robot state to produce the actions and perform the same task as shown in the video.
See, Plan, Predict: Language-guided Cognitive Planning with Video Prediction
Cognitive planning is the structural decomposition of complex tasks into a sequence of future behaviors.
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language
Large pretrained (e. g., "foundation") models exhibit distinct capabilities depending on the domain of data they are trained on.
Ranked #21 on
Video Retrieval
on MSR-VTT-1kA
(video-to-text R@1 metric)
Transforming Neural Network Visual Representations to Predict Human Judgments of Similarity
Deep-learning vision models have shown intriguing similarities and differences with respect to human vision.
Combining Learned Lyrical Structures and Vocabulary for Improved Lyric Generation
The use of language models for generating lyrics and poetry has received an increased interest in the last few years.
