Apache Spark for Data Engineering and Machine Learning
Apache® Spark™ is a fast, flexible, and developer-friendly open-source platform for large-scale SQL, batch processing, stream processing, and machine learning. Users can take advantage of its open-source ecosystem, speed, ease of use, and analytic capabilities to work with Big Data in new ways.
In this short course, you explore concepts and gain hands-on skills to use Spark for data engineering and machine learning applications. You'll learn about Spark Structured Streaming, including data sources, output modes, operations. Then, explore how Graph theory works and discover how GraphFrames supports Spark DataFrames and popular algorithms.
Organizations can acquire data from structured and unstructured sources and deliver the data to users in formats they can use. Learn how to use Spark for extract, transform and load (ETL) data. Then, you'll hone your newly acquired skills during your "ETL for Machine Learning Pipelines" lab.
Next, discover why machine learning practitioners prefer Spark. You'll learn how to create pipelines and quickly implement features for extraction, selections, and transformations on structured data sets. Discover how to perform classification and regression using Spark. You'll be able to define and identify both supervised and unsupervised learning. Learn about clustering and how to apply the k-mean s clustering algorithm using Spark MLlib. You'll reinforce your knowledge with focused, hands-on labs and a final project where you will apply Spark to a real-world inspired problem.
Prior to taking this course, please ensure you have foundational Spark knowledge and skills, for example, by first completing the IBM course titled "Big Data, Hadoop and Spark Basics."
What you'll learn
- Describe the features, benefits, limitations, and application of Apache Spark Structured Streaming
- Describe Graph theory and explain how GraphFrames benefits developers
- Explain how developers can apply extract, transform and load (ETL) processes using Spark.
- Describe how Spark ML supports machine learning development
- Apply Spark ML for regression and classification
- Differentiate between supervised and unsupervised Machine learning"
- Explain how Spark ML uses clustering
- Demonstrate hands-on working knowledge of using Spark for ETL processes
Get a Reminder
Rating | Not enough ratings |
---|---|
Length | 3 weeks |
Effort | 3 weeks, 2–3 hours per week |
Starts | On Demand (Start anytime) |
Cost | $49 |
From | IBM via edX |
Instructors | Romeo Kienzler, Karthik Muthuraman |
Download Videos | On all desktop and mobile devices |
Language | English |
Subjects | Programming |
Tags | Computer Science |
Get a Reminder
Similar Courses
Careers
An overview of related careers and their average salaries in the US. Bars indicate income percentile.
Research Scientist-Machine Learning $55k
Cloud Architect - Azure / Machine Learning $75k
Watson Machine Learning Engineer $81k
Machine Learning Software Developer $103k
Software Engineer (Machine Learning) $116k
Applied Scientist, Machine Learning $130k
Autonomy and Machine Learning Solutions Architect $131k
Applied Scientist - Machine Learning -... $136k
RESEARCH SCIENTIST (MACHINE LEARNING) $147k
Machine Learning Engineer 2 $161k
Machine Learning Scientist Manager $170k
Machine Learning Scientist, Personalization $213k
Write a review
Your opinion matters. Tell us what you think.
Please login to leave a review
Rating | Not enough ratings |
---|---|
Length | 3 weeks |
Effort | 3 weeks, 2–3 hours per week |
Starts | On Demand (Start anytime) |
Cost | $49 |
From | IBM via edX |
Instructors | Romeo Kienzler, Karthik Muthuraman |
Download Videos | On all desktop and mobile devices |
Language | English |
Subjects | Programming |
Tags | Computer Science |
Similar Courses
Sorted by relevance
Like this course?
Here's what to do next:
- Save this course for later
- Get more details from the course provider
- Enroll in this course