May 11, 2024
3 minute read
Horovod is a distributed training framework that enables deep learning models to be trained on multiple GPUs or CPUs. It is designed to be easy to use and efficient, and it has been shown to significantly reduce the training time of large models. Horovod is open-source and is available for use with TensorFlow, Keras, and PyTorch.
Why Learn Horovod?
There are several reasons why you might want to learn Horovod:
slovqk|
Find a path to becoming a Horovod. Learn more at:
OpenCourser.com/topic/slovqk/horovo
Reading list
We've selected three books
that we think will supplement your
learning. Use these to
develop background knowledge, enrich your coursework, and gain a
deeper understanding of the topics covered in
Horovod.
Provides a comprehensive overview of distributed deep learning and how to use Horovod to train deep learning models on multiple GPUs.
Covers the fundamentals of parallel programming and how to use Horovod to implement parallel algorithms.
Provides a comprehensive overview of distributed deep learning with Horovod. It is written by leading experts in deep learning and valuable resource for anyone who wants to learn how to use Horovod to train large-scale deep learning models.
For more information about how these books relate to this course, visit:
OpenCourser.com/topic/slovqk/horovo