We may earn an affiliate commission when you visit our partners.
Ben Goldberg
Elevate your career with our comprehensive online Kafka data streaming and data ingestion course. Learn Kafka and develop proficiency in real-time analytics.
Prerequisite details
Read more
Elevate your career with our comprehensive online Kafka data streaming and data ingestion course. Learn Kafka and develop proficiency in real-time analytics.
Prerequisite details
Read more
Elevate your career with our comprehensive online Kafka data streaming and data ingestion course. Learn Kafka and develop proficiency in real-time analytics.
Prerequisite details
To optimize your success in this program, we've created a list of prerequisites and recommendations to help you prepare for the curriculum. Prior to enrolling, you should have the following knowledge:
- Basic descriptive statistics
You will also need to be able to communicate fluently and professionally in written and spoken English.
Register for this course and see more details by visiting:
OpenCourser.com/course/trm3nu/data
Two deals to help you save
We found two deals and offers that may be relevant to this course.
Save money when you learn.
All coupon codes, vouchers, and discounts are applied automatically unless otherwise noted.
Use code at checkout.
Valid for a limited time only
Bootcamp level quality
Complete hands-on projects and get personalized feedback with Udacity.
Take
40%
off
UDACITY40
Valid for a limited time only
Future-proof your career
Access O'Reilly books, live events, courses, and more. Save with an annual subscription.
Take
15%
off
What's inside
Syllabus
In this lesson students will learn what data streaming is. Students will learn the pros and cons of data streaming, and how it compares to traditional data strategies.
Read more
Syllabus
In this lesson students will learn what data streaming is. Students will learn the pros and cons of data streaming, and how it compares to traditional data strategies.
Read more
In this lesson we’ll review the architecture and configuration of Apache Kafka.
This lesson covers data schemas and data schema management, with a focus on Apache Avro.
This lesson covers producing and consuming data into Kafka with Kafka Connect and REST Proxy.
Learn to build real-time applications that instantly process events, the concepts of stream processing state storage, windowed processing, and stateful and non-stateful stream processing.
Students will learn how to use the Python stream processing library Faust to rapidly create powerful stream processing applications.
Learn how to write simple SQL queries to turn Kafka topics into KSQL streams and tables, and then write those tables back out to Kafka.
For your first project, you’ll be streaming public transit status using Kafka and the Kafka ecosystem to build a stream processing application that shows the status of trains in real-time.
Good to know
Good to know
Know what's good ,
what to watch for , and
possible dealbreakers
Taught by Ben Goldberg, who is a professional in the technology industry
Taught through Udacity, which is an online learning platform recognized for its technology courses
Examines data streaming, which is highly relevant to the IT industry
Develops proficiency in real-time analytics, which is a valuable skill for data analysts
Provides hands-on labs and interactive materials for a practical learning experience
Requires prerequisite knowledge in basic descriptive statistics, which may limit accessibility for some learners
Save this course
Save Data Ingestion with Kafka and Kafka Streaming to your list so you can find it easily later:
Save
Save
Activities
Be better prepared
before
your course. Deepen your understanding
during
and
after
it. Supplement your coursework and achieve mastery of the topics covered
in Data Ingestion with Kafka and Kafka Streaming with these
activities:
Review data streaming and stream processing
Show steps
Review the basics of data streaming and stream processing to ensure you have a solid foundation for this course.
Browse courses on
Data Streaming
Show steps
-
Review the concepts of data streaming and real-time analytics.
-
Explore the different types of stream processing applications.
-
Familiarize yourself with the Apache Kafka ecosystem.
Review Kafka: The Definitive Guide
Show steps
Review Kafka: The Definitive Guide to gain a comprehensive understanding of the Kafka ecosystem.
View
Kafka: The Definitive Guide: Real-Time Data and...
on Amazon
Show steps
-
Read the book and take notes.
-
Work through the exercises in the book.
-
Discuss the book with other learners in a study group or online forum.
Practice writing Kafka producers and consumers
Show steps
Practice writing Kafka producers and consumers to gain hands-on experience with the Kafka ecosystem.
Browse courses on
Kafka Producers
Show steps
-
Create a Kafka producer to send messages to a topic.
-
Create a Kafka consumer to receive messages from a topic.
-
Use Apache Avro to define the schema of your messages.
-
Use Kafka Connect to connect Kafka to other systems.
One other activity
Expand to see all activities and additional details
Show all four activities
Build a stream processing application with Kafka
Show steps
Build a stream processing application with Kafka to apply your knowledge and skills to a real-world project.
Show steps
-
Design the architecture of your stream processing application.
-
Implement your application using Kafka Streams or Faust.
-
Test and deploy your application.
Review data streaming and stream processing
Show steps
Review the basics of data streaming and stream processing to ensure you have a solid foundation for this course.
Browse courses on
Data Streaming
Show steps
Show steps
Show steps
- Review the concepts of data streaming and real-time analytics.
- Explore the different types of stream processing applications.
- Familiarize yourself with the Apache Kafka ecosystem.
Review Kafka: The Definitive Guide
Show steps
Review Kafka: The Definitive Guide to gain a comprehensive understanding of the Kafka ecosystem.
View
Kafka: The Definitive Guide: Real-Time Data and...
on Amazon
Show steps
Show steps
Show steps
- Read the book and take notes.
- Work through the exercises in the book.
- Discuss the book with other learners in a study group or online forum.
Practice writing Kafka producers and consumers
Show steps
Practice writing Kafka producers and consumers to gain hands-on experience with the Kafka ecosystem.
Browse courses on
Kafka Producers
Show steps
Show steps
Show steps
- Create a Kafka producer to send messages to a topic.
- Create a Kafka consumer to receive messages from a topic.
- Use Apache Avro to define the schema of your messages.
- Use Kafka Connect to connect Kafka to other systems.
One other activity
Expand to see all activities and additional details
Show all four activities
Build a stream processing application with Kafka
Show steps
Build a stream processing application with Kafka to apply your knowledge and skills to a real-world project.
Show steps
Show steps
Show steps
- Design the architecture of your stream processing application.
- Implement your application using Kafka Streams or Faust.
- Test and deploy your application.
Career center
Learners who complete Data Ingestion with Kafka and Kafka Streaming will develop knowledge and skills
that may be useful to these careers:
Data Scientist - Data Engineering
Data Scientist - Data Engineering
A Data Scientist - Data Engineering designs and builds data pipelines and machine learning models. This course may be useful to a Data Scientist - Data Engineering who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Machine Learning Engineer
Machine Learning Engineer
A Machine Learning Engineer develops, deploys, and maintains machine learning models. This course may be useful to a Machine Learning Engineer who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Business Analyst
Business Analyst
A Business Analyst analyzes business processes and develops solutions to improve efficiency and effectiveness. This course may be useful to a Business Analyst who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Data Scientist
Data Scientist
A Data Scientist is a professional who uses scientific methods, processes, algorithms, and systems to extract knowledge and insights from data in various forms, both structured and unstructured. This course may be useful to a Data Scientist who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Data Analyst
Data Analyst
A Data Analyst collects, analyzes, interprets, and presents data to help organizations make informed decisions. This course may be useful to a Data Analyst who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Product Manager
Product Manager
A Product Manager is responsible for the development and execution of product strategy. This course may be useful to a Product Manager who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Data Engineer
Data Engineer
A Data Engineer designs, builds, and maintains data pipelines that move data between data sources and data destinations. This course may be useful to a Data Engineer who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Cloud Architect
Cloud Architect
A Cloud Architect designs and manages cloud computing systems. This course may be useful to a Cloud Architect who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
DevOps Engineer
DevOps Engineer
A DevOps Engineer automates and manages the software development lifecycle. This course may be useful to a DevOps Engineer who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Data Quality Analyst
Data Quality Analyst
A Data Quality Analyst ensures that data is accurate, complete, and consistent. This course may be useful to a Data Quality Analyst who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Data Science Manager
Data Science Manager
A Data Science Manager leads a team of data scientists and data engineers. This course may be useful to a Data Science Manager who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Data Governance Analyst
Data Governance Analyst
A Data Governance Analyst ensures that data is used in a consistent and ethical manner. This course may be useful to a Data Governance Analyst who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Big Data Engineer
Big Data Engineer
A Big Data Engineer designs, builds, maintains, and manages big data systems that can handle large volumes of data. This course may be useful to a Big Data Engineer who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Data Integration Engineer
Data Integration Engineer
A Data Integration Engineer designs and builds data integration systems. This course may be useful to a Data Integration Engineer who wishes to enter the subfield of data streaming or advance their career in this field. This course covers topics such as data streaming, Apache Kafka architecture and configuration, data schemas and data schema management, producing and consuming data into Kafka with Kafka Connect and REST Proxy, and real-time applications that instantly process events.
Software Engineer
Software Engineer
A Software Engineer is a computing professional who designs, develops, maintains, and tests software systems. This course may be useful to a Software Engineer who wishes to enter the subfield of data streaming or advance their career in this field. This course teaches the architecture and configuration of Apache Kafka, as well as data schemas and data schema management with a focus on Apache Avro.
For more career information including salaries, visit:
OpenCourser.com/course/trm3nu/data
Reading list
We've selected five books
that we think will supplement your
learning. Use these to
develop background knowledge, enrich your coursework, and gain a
deeper understanding of the topics covered in
Data Ingestion with Kafka and Kafka Streaming.
Shows how to use Kafka and Spark together to build real-time data pipelines. It covers everything from data ingestion to stream processing to data visualization. It valuable resource for anyone who wants to build real-time data pipelines using Kafka and Spark.
Collection of recipes for solving common problems with Kafka. It covers a wide range of topics, from installation to production deployment.
Practical guide to using Kafka for beginners. It covers the basics of Kafka, as well as more advanced topics, such as security and monitoring.
Comprehensive guide to Kafka for beginners. It covers the basics of Kafka, as well as more advanced topics, such as security and monitoring.
Save
Comprehensive guide to Kafka for beginners. It covers the basics of Kafka, as well as more advanced topics, such as security and monitoring.
For more information about how these books relate to this course, visit:
OpenCourser.com/course/trm3nu/data
Share
Similar courses
Here are nine courses similar to
Data Ingestion with Kafka and Kafka Streaming.
Apache Kafka - An Introduction
OpenCourser.com/course/fe68gp/apache
Apache Kafka - An Introduction
Most relevant
Kafka Fundamentals
OpenCourser.com/course/lbxg83/kafka
Kafka Fundamentals
Most relevant
Kafka: Build, Deploy, and Monitor Your First Real-world Application
OpenCourser.com/course/ac095b/kafka
Kafka: Build, Deploy, and Monitor Your First Real-world...
Most relevant
Processing Streaming Data Using Apache Spark Structured Streaming
OpenCourser.com/course/h50wty/processing
Processing Streaming Data Using Apache Spark Structured...
Most relevant
Windowing and Join Operations on Streaming Data with Apache Spark on Databricks
OpenCourser.com/course/ns81l0/windowing
Windowing and Join Operations on Streaming Data with...
Most relevant
Applying the Lambda Architecture with Spark, Kafka, and Cassandra
OpenCourser.com/course/t4b7iq/applying
Applying the Lambda Architecture with Spark, Kafka, and...
Most relevant
Kafka Connect Fundamentals
OpenCourser.com/course/oxvwzx/kafka
Kafka Connect Fundamentals
Most relevant
Kafka Integration with Storm, Spark, Flume, and Security
OpenCourser.com/course/g474ah/kafka
Kafka Integration with Storm, Spark, Flume, and Security
Most relevant
Apache Kafka Series - Learn Apache Kafka for Beginners v3
OpenCourser.com/course/riz3oj/apache
Apache Kafka Series - Learn Apache Kafka for Beginners v3
Most relevant
Effort
4 weeks
Via
Udacity
Instructor
Ben Goldberg
Language
English
Good to know
Taught by Ben Goldberg, who is a professional in the technology industry
Taught through Udacity, which is an online learning platform recognized for its technology courses
Examines data streaming, which is highly relevant to the IT industry
Develops proficiency in real-time analytics, which is a valuable skill for data analysts
Provides hands-on labs and interactive materials for a practical learning experience
Requires prerequisite knowledge in basic descriptive statistics, which may limit accessibility for some learners
Our mission
OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.
Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.
Find this site helpful? Tell a friend about us.
Affiliate disclosure
We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.
Your purchases help us maintain our catalog and keep our servers humming without ads.
Thank you for supporting OpenCourser.
© 2016 - 2024 OpenCourser