May 1, 2024
Updated June 22, 2025
17 minute read
Understanding Resilient Distributed Datasets (RDDs)
Resilient Distributed Datasets, commonly known as RDDs, are a fundamental data structure in Apache Spark. At a high level, an RDD is an immutable, distributed collection of objects that can be processed in parallel across a cluster of computers. Think of it as a special kind of list or collection, but one that is spread out over many machines and can automatically recover from failures. This makes RDDs particularly well-suited for large-scale data processing tasks.
b0akpk|
Find a path to becoming a RDD. Learn more at:
OpenCourser.com/topic/b0akpk/rd
Reading list
We've selected six books
that we think will supplement your
learning. Use these to
develop background knowledge, enrich your coursework, and gain a
deeper understanding of the topics covered in
RDD.
Provides a comprehensive overview of Apache Spark, including RDDs, and is written by some of the creators of Spark.
Provides a comprehensive overview of Spark, including RDDs, and is written by one of the creators of Spark.
Provides a beginner's guide to Spark, including RDDs.
Teaches Python, another language used to develop Spark, and shows how to use it with RDDs.
Focuses on using Spark for data science, including using RDDs for data analysis.
Covers advanced Spark topics, including using RDDs for machine learning and data mining.
For more information about how these books relate to this course, visit:
OpenCourser.com/topic/b0akpk/rd