Search Results for author:
Found 15 papers, 1 papers with code
Multi-Stage Multi-Modal Pre-Training for Automatic Speech Recognition
Recent advances in machine learning have demonstrated that multi-modal pre-training can improve automatic speech recognition (ASR) performance compared to randomly initialized models, even when models are fine-tuned on uni-modal tasks.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
conv_einsum: A Framework for Representation and Fast Evaluation of Multilinear Operations in Convolutional Tensorial Neural Networks
Modern ConvNets continue to achieve state-of-the-art results over a vast array of vision and image classification tasks, but at the cost of increasing parameters.
See Say and Segment: Teaching LMMs to Overcome False Premises
Current open-source Large Multimodal Models (LMMs) excel at tasks such as open-vocabulary language grounding and segmentation but can suffer under false premises when queries imply the existence of something that is not actually present in the image.
See, Say, and Segment: Teaching LMMs to Overcome False Premises
Current open-source Large Multimodal Models (LMMs) excel at tasks such as open-vocabulary language grounding and segmentation but can suffer under false premises when queries imply the existence of something that is not actually present in the image.
CLAIR: Evaluating Image Captions with Large Language Models
The evaluation of machine-generated image captions poses an interesting yet persistent challenge.
Scalable and Accurate Self-supervised Multimodal Representation Learning without Aligned Video and Text Data
Currently popular video-text data mining approach via automatic speech recognition (ASR) used in HowTo100M provides low-quality captions that often do not refer to the video content.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+5
LAVA: Language Audio Vision Alignment for Contrastive Video Pre-Training
Generating representations of video data is of key importance in advancing the field of machine perception.
Misinformation Detection in Social Media Video Posts
With the growing adoption of short-form video by social media platforms, reducing the spread of misinformation through video posts has become a critical challenge for social media providers.
Decision Tree-Based Predictive Models for Academic Achievement Using College Students' Support Networks
For White students, different types of educational support were important in predicting academic achievement, while for non-White students, different types of emotional support were important in predicting academic achievement.
A Dataset and Benchmarks for Multimedia Social Analysis
We present a new publicly available dataset with the goal of advancing multi-modality learning by offering vision and language data within the same context.
ZPD Teaching Strategies for Deep Reinforcement Learning from Demonstrations
Learning from demonstrations is a popular tool for accelerating and reducing the exploration requirements of reinforcement learning.
Leveraging Class Similarity to Improve Deep Neural Network Robustness
Traditionally artificial neural networks (ANNs) are trained by minimizing the cross-entropy between a provided groundtruth delta distribution (encoded as one-hot vector) and the ANN's predictive softmax distribution.
Bias Correction For Paid Search In Media Mix Modeling
Evaluating the return on ad spend (ROAS), the causal effect of advertising on sales, is critical to advertisers for understanding the performance of their existing marketing strategy as well as how to improve and optimize it.
Applications
Facial Expression Recognition from World Wild Web
In fact, the Internet is a Word Wild Web of facial images with expressions.
Facial Expression Recognition
Facial Expression Recognition (FER)
Going Deeper in Facial Expression Recognition using Deep Neural Networks
Despite efforts made in developing various methods for FER, existing approaches traditionally lack generalizability when applied to unseen images or those that are captured in wild setting.
Facial Expression Recognition
Facial Expression Recognition (FER)
