Search Results for author:
Found 20 papers, 15 papers with code
Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey
In this survey, we carefully review over 300 articles, focusing on KG-aware research in two principal aspects: KG-driven Multi-Modal (KG4MM) learning, where KGs support multi-modal tasks, and Multi-Modal Knowledge Graph (MM4KG), which extends KG studies into the MMKG realm.
Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Model
Accordingly, we propose a new KGC method named PDKGC with two prompts -- a hard task prompt which is to adapt the KGC task to the PLM pre-training task of token prediction, and a disentangled structure prompt which learns disentangled graph representation so as to enable the PLM to combine more relevant structure knowledge with the text information.
Structure Pretraining and Prompt Tuning for Knowledge Graph Transfer
Through experiments, we justify that the pretrained KGTransformer could be used off the shelf as a general and effective KRF module across KG-related tasks.
Generalizing to Unseen Elements: A Survey on Knowledge Extrapolation for Knowledge Graphs
In this paper, we use a set of general terminologies to unify these methods and refer to them collectively as Knowledge Extrapolation.
MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybrid
Multi-modal entity alignment (MMEA) aims to discover identical entities across different knowledge graphs (KGs) whose entities are associated with relevant images.
Ranked #1 on
Entity Alignment
on FBYG15k
(using extra training data)
Tele-Knowledge Pre-training for Fault Analysis
In this work, we share our experience on tele-knowledge pre-training for fault analysis, a crucial task in telecommunication applications that requires a wide range of knowledge normally found in both machine log data and product documents.
Relational Message Passing for Fully Inductive Knowledge Graph Completion
Subgraph reasoning with message passing is a promising and popular solution.
LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection
Visual question answering (VQA) often requires an understanding of visual concepts and language semantics, which relies on external knowledge.
Ranked #21 on
Visual Question Answering (VQA)
on OK-VQA
DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learning
Specifically, we (1) developed a cross-modal semantic grounding network to investigate the model's capability of disentangling semantic attributes from the images; (2) applied an attribute-level contrastive learning strategy to further enhance the model's discrimination on fine-grained visual characteristics against the attribute co-occurrence and imbalance; (3) proposed a multi-task learning policy for considering multi-model objectives.
Ranked #1 on
Zero-Shot Learning
on CUB-200-2011
Disentangled Ontology Embedding for Zero-shot Learning
In this paper, we focus on ontologies for augmenting ZSL, and propose to learn disentangled ontology embeddings guided by ontology properties to capture and utilize more fine-grained class relationships in different aspects.
Contextual Semantic Embeddings for Ontology Subsumption Prediction
Automating ontology construction and curation is an important but challenging task in knowledge engineering and artificial intelligence.
Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Survey
Machine learning especially deep neural networks have achieved great success but many of them often rely on a number of labeled samples for supervision.
Zero-shot Visual Question Answering using Knowledge Graph
Incorporating external knowledge to Visual Question Answering (VQA) has become a vital practical need.
Ranked #1 on
Visual Question Answering (VQA)
on F-VQA
Knowledge-aware Zero-Shot Learning: Survey and Perspective
Zero-shot learning (ZSL) which aims at predicting classes that have never appeared during the training using external knowledge (a. k. a.
OntoZSL: Ontology-enhanced Zero-shot Learning
The key of implementing ZSL is to leverage the prior knowledge of classes which builds the semantic relationship between classes and enables the transfer of the learned models (e. g., features) from training classes (i. e., seen classes) to unseen classes.
Zero-shot Text Classification via Reinforced Self-training
In this situation, transferring from seen classes to unseen classes is extremely hard.
Ontology-guided Semantic Composition for Zero-Shot Learning
Zero-shot learning (ZSL) is a popular research problem that aims at predicting for those classes that have never appeared in the training stage by utilizing the inter-class relationship with some side information.
Generative Adversarial Zero-shot Learning via Knowledge Graphs
However, the side information of classes used now is limited to text descriptions and attribute annotations, which are in short of semantics of the classes.
Human-centric Transfer Learning Explanation via Knowledge Graph [Extended Abstract]
Transfer learning which aims at utilizing knowledge learned from one problem (source domain) to solve another different but related problem (target domain) has attracted wide research attentions.
