Irvine, California +1 949 264 1472 info@xavor.com

Distributed Training Using Horovod and Keras

Introduction to Horovod Horovod is a distributed deep learning training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. The goal of Horovod is to make distributed deep learning fast and easy to use. Horovod core principles are based on MPI concepts such as size, rank, local rank, allreduce, allgather , and, broadcast. See this page for more details. Horovod is not just a wrapper around the […]