Machine Learning Pipelines with Modern Big Data Tools for High Energy Physics

1 code implementation • 23 Sep 2019 • Matteo Migliorini, Riccardo Castellotti, Luca Canali, Marco Zanetti

Training of the neural network models, defined using the Keras API, is performed in a distributed fashion on Spark clusters by using BigDL with Analytics Zoo and also by using TensorFlow, notably for distributed training on CPU and GPU resourcess.

BIG-bench Machine Learning Feature Engineering