Search Results for author:
Found 11 papers, 2 papers with code
Verify when Uncertain: Beyond Self-Consistency in Black Box Hallucination Detection
We empirically study these techniques and show that they achieve performance close to that of a supervised (still black-box) oracle, suggesting little room for improvement within this paradigm.
Representations Shape Weak-to-Strong Generalization: Theoretical Insights and Empirical Predictions
While recent work has offered theoretical insights into this phenomenon, a clear understanding of the interactions between weak and strong models that drive W2SG remains elusive.
TFPred: Learning Discriminative Representations from Unlabeled Data for Few-Label Rotating Machinery Fault Diagnosis
Recent advances in intelligent rotating machinery fault diagnosis have been enabled by the availability of massive labeled training data.
Investigating the Benefits of Projection Head for Representation Learning
An effective technique for obtaining high-quality representations is adding a projection head on top of the encoder during training, then discarding it and using the pre-projection representations.
Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift
Recently, multimodal contrastive learning (MMCL) approaches, such as CLIP, have achieved a remarkable success in learning representations that are robust against distribution shift and generalize to new domains.
Challenges and Opportunities in Improving Worst-Group Generalization in Presence of Spurious Features
Through this, we highlight how existing group inference methods struggle in the presence of spurious features that are learned later in training.
Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression
However, supervised CL is prone to collapsing representations of subclasses within a class by not capturing all their features, and unsupervised CL may suppress harder class-relevant features by focusing on learning easy class-irrelevant features; both significantly compromise representation quality.
Few-shot Adaptation to Distribution Shifts By Mixing Source and Target Embeddings
Pretrained machine learning models need to be adapted to distribution shifts when deployed in new target environments.
Investigating the Impact of Model Width and Density on Generalization in Presence of Label Noise
However, the effect of label noise on the test loss curve has not been fully explored.
Investigating Why Contrastive Learning Benefits Robustness Against Label Noise
Self-supervised Contrastive Learning (CL) has been recently shown to be very effective in preventing deep networks from overfitting noisy labels.
Toward Understanding the Influence of Individual Clients in Federated Learning
Federated learning allows mobile clients to jointly train a global model without sending their private data to a central server.
