Search Results for author:
Found 8 papers, 2 papers with code
Pretraining Billion-scale Geospatial Foundational Models on Frontier
Although large FMs have demonstrated significant impact in natural language processing and computer vision, efforts toward FMs for geospatial applications have been restricted to smaller size models, as pretraining larger models requires very large computing resources equipped with state-of-the-art hardware accelerators.
Ultra-Long Sequence Distributed Transformer
This paper presents a novel and efficient distributed training method, the Long Short-Sequence Transformer (LSS Transformer), for training transformer with long sequences.
Image Gradient Decomposition for Parallel and Memory-Efficient Ptychographic Reconstruction
In this paper, we propose a novel image gradient decomposition method that significantly reduces the memory footprint for ptychographic reconstruction by tessellating image gradients and diffraction measurements into tiles.
MLPerf HPC: A Holistic Benchmark Suite for Scientific Machine Learning on HPC Systems
Scientific communities are increasingly adopting machine learning and deep learning models in their applications to accelerate scientific insights.
Track Seeding and Labelling with Embedded-space Graph Neural Networks
Detector information can be associated with nodes and edges, enabling a GNN to propagate the embedded parameters around the graph and predict node-, edge- and graph-level observables.
Graph Neural Networks for Particle Reconstruction in High Energy Physics detectors
Pattern recognition problems in high energy physics are notably different from traditional machine learning applications in computer vision.
Instrumentation and Detectors High Energy Physics - Experiment Computational Physics Data Analysis, Statistics and Probability
FPGA-accelerated machine learning inference as a service for particle physics computing
New heterogeneous computing paradigms on dedicated hardware with increased parallelization, such as Field Programmable Gate Arrays (FPGAs), offer exciting solutions with large potential gains.
Data Analysis, Statistics and Probability High Energy Physics - Experiment Computational Physics Instrumentation and Detectors
Novel deep learning methods for track reconstruction
The second set of models use Graph Neural Networks (GNNs) for the tasks of hit classification and segment classification.
High Energy Physics - Experiment Data Analysis, Statistics and Probability
