1 code implementation • 30 May 2024 • Costas Mavromatis, George Karypis
In our GNN-RAG framework, the GNN acts as a dense subgraph reasoner to extract useful graph information, while the LLM leverages its natural language processing ability for ultimate KGQA.
1 code implementation • 17 Apr 2024 • Costas Mavromatis, Petros Karypis, George Karypis
PackLLM performs model fusion by solving an optimization problem for determining each LLM's importance, so that perplexity over the input prompt is minimized.
no code implementations • 3 Feb 2024 • Costas Mavromatis, Petros Karypis, George Karypis
Our method, termed SemPool, represents KG facts with pre-trained LMs, learns to aggregate their semantic information, and fuses it at different layers of the LM.
1 code implementation • 30 Oct 2023 • Costas Mavromatis, Balasubramaniam Srinivasan, Zhengyuan Shen, Jiani Zhang, Huzefa Rangwala, Christos Faloutsos, George Karypis
Large Language Models (LLMs) can adapt to new tasks via in-context learning (ICL).
1 code implementation • 20 Apr 2023 • Costas Mavromatis, Vassilis N. Ioannidis, Shen Wang, Da Zheng, Soji Adeshina, Jun Ma, Han Zhao, Christos Faloutsos, George Karypis
Different from conventional knowledge distillation, GRAD jointly optimizes a GNN teacher and a graph-free student over the graph's nodes via a shared LM.
1 code implementation • 24 Oct 2022 • Costas Mavromatis, George Karypis
Our method, termed ReaRev, introduces a new way to KGQA reasoning with respect to both instruction decoding and execution.
Ranked #1 on Semantic Parsing on WebQuestionsSP
1 code implementation • 10 Dec 2021 • Costas Mavromatis, Prasanna Lakkur Subramanyam, Vassilis N. Ioannidis, Soji Adeshina, Phillip R. Howard, Tetiana Grinberg, Nagib Hakim, George Karypis
The first computes a textual representation of a given question, the second combines it with the entity embeddings for entities involved in the question, and the third generates question-specific time embeddings.
Ranked #1 on Question Answering on CronQuestions
1 code implementation • 14 Sep 2021 • Costas Mavromatis, George Karypis
Many real-world graphs involve different types of nodes and relations between nodes, being heterogeneous by nature.
no code implementations • 17 Apr 2021 • Konstantinos D. Polyzos, Costas Mavromatis, Vassilis N. Ioannidis, Georgios B. Giannakis
Uncovering anomalies in attributed networks has recently gained popularity due to its importance in unveiling outliers and flagging adversarial behavior in a gamut of data and network science applications including {the Internet of Things (IoT)}, finance, security, to list a few.
2 code implementations • 15 Sep 2020 • Costas Mavromatis, George Karypis
Motivated by this observation, we propose a graph representation learning method called Graph InfoClust (GIC), that seeks to additionally capture cluster-level information content.
Ranked #2 on Link Prediction on Citeseer