Search Results for author:
Found 25 papers, 9 papers with code
DF-GNN: Dynamic Fusion Framework for Attention Graph Neural Networks on GPUs
The execution of AT-GNN operations without kernel fusion results in heavy data movement and significant kernel launch overhead, while fixed thread scheduling in existing GNN kernel fusion strategies leads to sub-optimal performance, redundant computation and unbalanced workload.
ELF-Gym: Evaluating Large Language Models Generated Features for Tabular Prediction
But despite this potential, evaluations thus far are primarily based on the end performance of a complete ML pipeline, providing limited insight into precisely how LLMs behave relative to human experts in feature engineering.
Deep progressive reinforcement learning-based flexible resource scheduling framework for IRS and UAV-assisted MEC system
Our goal is to minimize the energy consumption of the MEC system by jointly optimizing UAV locations, IRS phase shift, task offloading, and resource allocation with a variable number of UAVs.
DiskGNN: Bridging I/O Efficiency and Model Accuracy for Out-of-Core GNN Training
In particular, by conducting graph sampling beforehand, DiskGNN acquires the node features that will be accessed by model computation, and such information is utilized to pack the target node features contiguously on disk to avoid read amplification.
4DBInfer: A 4D Benchmarking Toolbox for Graph-Centric Predictive Modeling on Relational DBs
Although RDBs store vast amounts of rich, informative data spread across interconnected tables, the progress of predictive machine learning models as applied to such tasks arguably falls well behind advances in other domains such as computer vision or natural language processing.
BloomGML: Graph Machine Learning through the Lens of Bilevel Optimization
These optimal features typically depend on tunable parameters of the lower-level energy in such a way that the entire bilevel pipeline can be trained end-to-end.
GNNFlow: A Distributed Framework for Continuous Temporal GNN Learning on Dynamic Graphs
We introduce GNNFlow, a distributed framework that enables efficient continuous temporal graph representation learning on dynamic graphs on multi-GPU machines.
Causal Discovery with Generalized Linear Models through Peeling Algorithms
This article presents a novel method for causal discovery with generalized structural equation models suited for analyzing diverse types of outcomes, including discrete, continuous, and mixed data.
MuseGNN: Interpretable and Convergent Graph Neural Network Layers at Scale
Among the many variants of graph neural network (GNN) architectures capable of modeling data with cross-instance relations, an important subclass involves layers designed such that the forward pass iteratively reduces a graph-regularized energy function of interest.
FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training
A key performance bottleneck when training graph neural network (GNN) models on large, real-world graphs is loading node features onto a GPU.
DGI: Easy and Efficient Inference for GNNs
In this paper, we develop Deep Graph Inference (DGI) -- a system for easy and efficient GNN model inference, which automatically translates the training code of a GNN model for layer-wise execution.
CEP3: Community Event Prediction with Neural Point Process on Graph
Many real world applications can be formulated as event forecasting on Continuous Time Dynamic Graphs (CTDGs) where the occurrence of a timed event between two entities is represented as an edge along with its occurrence timestamp in the graphs. However, most previous works approach the problem in compromised settings, either formulating it as a link prediction task on the graph given the event time or a time prediction problem given which event will happen next.
Fast and Accurate Graph Learning for Huge Data via Minipatch Ensembles
Gaussian graphical models provide a powerful framework for uncovering conditional dependence relationships between sets of nodes; they have found applications in a wide variety of fields including sensor and communication networks, physics, finance, and computational biology.
Kokoyi: Executable LaTeX for End-to-end Deep Learning
Despite substantial efforts from the deep learning system community to relieve researchers and practitioners from the burden of implementing models with ever-growing complexity, a considerable lingual gap remains between developing models in the language of mathematics and implementing them in the languages of computer.
Thresholded Graphical Lasso Adjusts for Latent Variables: Application to Functional Neural Connectivity
In neuroscience, researchers seek to uncover the connectivity of neurons from large-scale neural recordings or imaging; often people employ graphical model selection and estimation techniques for this purpose.
DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphs
To minimize the overheads associated with distributed computations, DistDGL uses a high-quality and light-weight min-cut graph partitioning algorithm along with multiple balancing constraints.
FeatGraph: A Flexible and Efficient Backend for Graph Neural Network Systems
FeatGraph provides a flexible programming interface to express diverse GNN models by composing coarse-grained sparse templates with fine-grained user-defined functions (UDFs) on each vertex/edge.
Supervised Convex Clustering
Clustering has long been a popular unsupervised learning approach to identify groups of similar objects and discover patterns from unlabeled data in many applications.
Integrative Generalized Convex Clustering Optimization and Feature Selection for Mixed Multi-View Data
While several techniques for such integrative clustering have been explored, we propose and develop a convex formalization that will inherit the strong statistical, mathematical and empirical properties of increasingly popular convex clustering methods.
Characterize and Transfer Attention in Graph Neural Networks
Does attention matter and, if so, when and how?
Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks
Advancing research in the emerging field of deep graph learning requires new tools to support tensor computation over graphs.
Ranked #34 on
Node Classification
on Cora
Learned Indexes for Dynamic Workloads
In this paper, we demonstrate that the missing consideration of access patterns and dynamic data distribution notably hinders the applicability of learned indexes.
Supporting Very Large Models using Automatic Dataflow Graph Partitioning
This paper presents Tofu, a system that partitions very large DNN models across multiple GPU devices to reduce per-GPU memory footprint.
Unifying Data, Model and Hybrid Parallelism in Deep Learning via Tensor Tiling
We present this automatic tiling in a new system, SoyBean, that can act as a backend for Tensorflow, MXNet, and others.
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
This paper describes both the API design and the system implementation of MXNet, and explains how embedding of both symbolic expression and tensor operation is handled in a unified fashion.
