Search Results for author: Maciej Besta

Found 15 papers, 4 papers with code

Demystifying Chains, Trees, and Graphs of Thoughts

no code implementations25 Jan 2024 Maciej Besta, Florim Memedi, Zhenyu Zhang, Robert Gerstenberger, Guangyuan Piao, Nils Blach, Piotr Nyczyk, Marcin Copik, Grzegorz Kwaśniewski, Jürgen Müller, Lukas Gianinazzi, Ales Kubicek, Hubert Niewiadomski, Aidan O'Mahony, Onur Mutlu, Torsten Hoefler

Among these, prompt engineering coupled with structures has emerged as a promising paradigm, with designs such as Chain-of-Thought, Tree of Thoughts, or Graph of Thoughts, in which the overall LLM reasoning is guided by a structure such as a graph.

Mathematical Reasoning Prompt Engineering

HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformers

no code implementations30 Nov 2023 Maciej Besta, Afonso Claudino Catarino, Lukas Gianinazzi, Nils Blach, Piotr Nyczyk, Hubert Niewiadomski, Torsten Hoefler

A fundamental workload in this setting is dynamic link prediction: using a history of graph updates to predict whether a given pair of vertices will become connected.

Dynamic Link Prediction Graph Representation Learning

Cached Operator Reordering: A Unified View for Fast GNN Training

no code implementations23 Aug 2023 Julia Bazinska, Andrei Ivanov, Tal Ben-Nun, Nikoli Dryden, Maciej Besta, Siyuan Shen, Torsten Hoefler

Graph Neural Networks (GNNs) are a powerful tool for handling structured graph data and addressing tasks such as node classification, graph classification, and clustering.

Graph Attention Graph Classification +1

Graph of Thoughts: Solving Elaborate Problems with Large Language Models

1 code implementation18 Aug 2023 Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Michal Podstawski, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Hubert Niewiadomski, Piotr Nyczyk, Torsten Hoefler

We introduce Graph of Thoughts (GoT): a framework that advances prompting capabilities in large language models (LLMs) beyond those offered by paradigms such as Chain-of-Thought or Tree of Thoughts (ToT).

Neural Graph Databases

no code implementations20 Sep 2022 Maciej Besta, Patrick Iff, Florian Scheidl, Kazuki Osawa, Nikoli Dryden, Michal Podstawski, Tiancheng Chen, Torsten Hoefler

In general, LPG2vec enables combining predictive power of the most powerful GNNs with the full scope of information encoded in the LPG model, paving the way for neural graph databases, a class of systems where the vast complexity of maintained data will benefit from modern and future graph machine learning methods.

Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysis

no code implementations19 May 2022 Maciej Besta, Torsten Hoefler

To alleviate this, we first design a taxonomy of parallelism in GNNs, considering data and model parallelism, and different forms of pipelining.

Graph Classification Link Prediction +1

Learning Combinatorial Node Labeling Algorithms

no code implementations7 Jun 2021 Lukas Gianinazzi, Maximilian Fries, Nikoli Dryden, Tal Ben-Nun, Maciej Besta, Torsten Hoefler

We present a novel neural architecture to solve graph optimization problems where the solution consists of arbitrary node labels, allowing us to solve hard problems like graph coloring.

BIG-bench Machine Learning Graph Attention +1

Motif Prediction with Graph Neural Networks

no code implementations26 May 2021 Maciej Besta, Raphael Grob, Cesare Miglioli, Nicola Bernold, Grzegorz Kwasniewski, Gabriel Gjini, Raghavendra Kanakagiri, Saleh Ashkboos, Lukas Gianinazzi, Nikoli Dryden, Torsten Hoefler

We also successfully apply our architecture for predicting more arbitrary clusters and communities, illustrating its potential for graph mining beyond motif analysis.

Graph Mining Link Prediction

Log(Graph): A Near-Optimal High-Performance Graph Representation

no code implementations29 Oct 2020 Maciej Besta, Dimitri Stanojevic, Tijana Zivic, Jagpreet Singh, Maurice Hoerold, Torsten Hoefler

Our high-performance Log(Graph) implementation based on modern bitwise operations and state-of-the-art succinct data structures achieves high compression ratios as well as performance.

Vocal Bursts Intensity Prediction

Practice of Streaming Processing of Dynamic Graphs: Concepts, Models, and Systems

no code implementations29 Dec 2019 Maciej Besta, Marc Fischer, Vasiliki Kalavri, Michael Kapralov, Torsten Hoefler

We also crystallize the meaning of different concepts associated with streaming graph processing, such as dynamic, temporal, online, and time-evolving graphs, edge-centric processing, models for the maintenance of updates, and graph databases.

Distributed, Parallel, and Cluster Computing Databases Data Structures and Algorithms Performance

Red-blue pebbling revisited: near optimal parallel matrix-matrix multiplication

1 code implementation26 Aug 2019 Grzegorz Kwasniewski, Marko Kabić, Maciej Besta, Joost VandeVondele, Raffaele Solcà, Torsten Hoefler

The key idea behind COSMA is to derive an optimal (up to a factor of 0. 03\% for 10MB of fast memory) sequential schedule and then parallelize it, preserving I/O optimality.

Computational Complexity Distributed, Parallel, and Cluster Computing Performance

Graph Processing on FPGAs: Taxonomy, Survey, Challenges

no code implementations25 Feb 2019 Maciej Besta, Dimitri Stanojevic, Johannes De Fine Licht, Tal Ben-Nun, Torsten Hoefler

To facilitate understanding of this emerging domain, we present the first survey and taxonomy on graph computations on FPGAs.

Distributed, Parallel, and Cluster Computing Hardware Architecture

A Modular Benchmarking Infrastructure for High-Performance and Reproducible Deep Learning

1 code implementation29 Jan 2019 Tal Ben-Nun, Maciej Besta, Simon Huber, Alexandros Nikolaos Ziogas, Daniel Peter, Torsten Hoefler

We introduce Deep500: the first customizable benchmarking infrastructure that enables fair comparison of the plethora of deep learning frameworks, algorithms, libraries, and techniques.

Benchmarking Vocal Bursts Intensity Prediction

Scaling betweenness centrality using communication-efficient sparse matrix multiplication

2 code implementations22 Sep 2016 Edgar Solomonik, Maciej Besta, Flavio Vella, Torsten Hoefler

Betweenness centrality (BC) is a crucial graph problem that measures the significance of a vertex by the number of shortest paths leading through it.

Distributed, Parallel, and Cluster Computing Discrete Mathematics Mathematical Software G.1.0; G.2.2

Cannot find the paper you are looking for? You can Submit a new open access paper.