Search Results for author:
Found 8 papers, 6 papers with code
ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline
Large language models (LLMs) have shown excellent mastering of human language, but still struggle in real-world applications that require mathematical problem-solving.
ChatGLM-RLHF: Practices of Aligning Large Language Models with Human Feedback
The work presents our practices of aligning LLMs with human preferences, offering insights into the challenges and solutions in RLHF implementations.
GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learner
Graph self-supervised learning (SSL), including contrastive and generative approaches, offers great potential to address the fundamental challenge of label scarcity in real-world graph data.
GraphMAE: Self-Supervised Masked Graph Autoencoders
Despite this, contrastive learning-which heavily relies on structural data augmentation and complicated training strategies-has been the dominant approach in graph SSL, while the progress of generative SSL on graphs, especially graph autoencoders (GAEs), has thus far not reached the potential as promised in other fields.
Ranked #1 on
Node Classification
on Cora: fixed 20 node per class
SCR: Training Graph Neural Networks with Consistency Regularization
However, it is unclear how to best design the generalization strategies in GNNs, as it works in a semi-supervised setting for graph data.
Ranked #3 on
Node Property Prediction
on ogbn-papers100M
Understanding WeChat User Preferences and "Wow" Diffusion
"Top Stories" is a novel friend-enhanced recommendation engine in WeChat, in which users can read articles based on preferences of both their own and their friends.
Graph Representation Learning
Social and Information Networks
CogDL: A Comprehensive Library for Graph Deep Learning
In CogDL, we propose a unified design for the training and evaluation of GNN models for various graph tasks, making it unique among existing graph learning libraries.
Self-supervised Learning: Generative or Contrastive
As an alternative, self-supervised learning attracts many researchers for its soaring performance on representation learning in the last several years.
