The new volume in the Apache Kafka Series.
The new volume in the Apache Kafka Series.
Learn Apache Avro, the Confluent Schema Registry for Apache Kafka and the Confluent REST Proxy for Apache Kafka. Join hundreds of knowledge savvy students into learning some of the most important components in a typical Apache Kafka stack.
Take a look at these student reviews...
5 stars - "Excellent course. A must for Apache Kafka users." – Mayank
5 stars -"Beautiful explanation of Avro and how to use it with Apache Kafka. This knowledge enhancing like all your other courses. We have Apache Kafka from Confluent in our enterprise and this is what I was exactly looking for. Thanks a lot." – Vinod
5 stars - "Stephane Maarek is truly remarkable instructor. His instructional videos do not disappoint, they keep me wanting more and provide exactly the Kafka skills needed to be successful." – Troy
Apache Avro is one of the most powerful and most popular fast data serialisation mechanism with Apache Kafka
> Schema is a first class citizen of the data> Data serialisation format that is lightweight> Documentation is embedded in the schema> Easy to read and write using many languages> Fast & Big data de-facto data serialisation format
Confluent Schema Registry for Apache Kafka is the de-facto standard way of storing Avro Schemas for your Apache Kafka Topics.
> Stores a versioned history of all your schemas in Apache Kafka> Supports and enforces conditions for schema evolution (backward, forward, full compatibility)> Kafka Avro Serialiser and Deserialiser automatically integrate with Apache Kafka and Confluent Schema Registry> Make your messages much smaller and lighter. Perfect for increasing Apache Kafka throughput and performance
Confluent REST Proxy is the perfect way to communicate for sending Avro data using non Java languages to Apache Kafka.
> Write and Read binary, JSON and Avro data to Apache Kafka using an HTTP REST API> Interact with Apache Kafka using any programming language (not just Java)> Consult topic list and topic metadata in Apache Kafka
Hands On & Theory Based Course
Note: This course is comprehensive, and the Apache Kafka related bits do not start before the Kafka Schema Registry section. This is to ensure Avro Schema and Avro in Java is fully understood before moving to the Confluent Schema Registry for Apache Kafka.
This course is the first and only available Kafka Schema Registry and Kafka REST Proxy course on the web. Get it now to become an Apache Kafka expert.
Instructor
My name is Stephane Maarek, and I'll be your instructor in this course. I teach about Apache Kafka, the Kafka ecosystem and Kafka Certifications with my focus always on helping my students improve their professional proficiencies. I am also the co-founder of Conduktor: an enterprise Apache Kafka platform & UI to help everyone use Kafka.
Throughout my career in designing and delivering these certifications and courses, I have already taught
With Apache Kafka becoming much more than a buzzword out there, I've decided it's time for students to properly learn how to be a Kafka professional. So, let’s kick start the course. You are in good hands.
This Course Also Comes With:
Lifetime Access to All Future Updates
A responsive instructor in the Q&A Section
Links to interesting articles, and lots of good code to base your next applications onto
Udemy Certificate of Completion Ready for Download
This is the course that could improve your career.
Apache Kafka is a skill in high demand and there are not enough people to fulfill all the open positions. You can boost your income, take on new roles and fun challenges. Many of my students are now the Kafka experts of their companies. You can be the next.
I hope to see you inside the course.
Note: Looking for more advanced Kafka concepts? There are many volumes in the Apache Kafka Series:
Learn Kafka for Beginners v2 (great to start)
Kafka Connect Hands On Learning
Kafka Streams for Data Processing
KSQL on ksqlDB - Hands On.
Kafka Cluster Setup & Administration
Confluent Schema Registry & Kafka REST Proxy
Kafka Security (
Short introduction that describes the need of a Schema Registry in Kafka
Learn about the course objectives and how the course is structure
Learn about Stephane Maarek, your instructor for this course
Visit the target architecture with Apache Kafka, the Confluent Schema Registry and the REST Proxy
Download all the code and tools for the course
Learn what Apache Avro is and how it came to be
Learn the Apache Avro primitive types
Learn how to define a Record Apache Avro Schema
Learn what are the Complex types for Apache Avro
Practice your newly acquired skills by creating a Customer and CustomerAddress Schema
Learn what are the possible Apache Avro logical types
Learn how to handle decimal numbers in Avro
Links to various Avro Schemas you can find on the web
Summary of all the things we have learned so far
Understand what we're trying to achieve with Avro in Java
Learn how to create a GenericRecord in Avro
Learn how to create a SpecificRecord in Avro
Check point to understand where we are now vs later when using Kafka
Hands-On practice with the Avro tools
Learn how to generate an Avro schema using Avro Reflection
Learn the theory behind schema evolution
Get Hands-On with Schema Evolution in Java
Section summary to understand how we used Java and Apache Avro library to build Avro objects.
Important information regarding the installation process
Install Docker for Mac if you have a recent Mac machine
Install Docker Toolbox on Mac if you have an older machine
Install Docker on Linux
Install Docker on recent Windows 10 64bit
Install Docker Toolbox on other Windows version
Increase the RAM for Docker
Frequently asked and common issues for Docker and Kafka Setup
Start our Kafka Cluster using Docker Compose
Introduction to the Confluent Schema Registry
Learn how to use the Kafka Avro Console Producer and Consumer
Learn how to use Java to write your first Avro Producer
Learn how to write an Avro consumer using Java
Re-visit what Schema Evolution is before we perform it in Java
Writing a V2 Java Kafka Avro Producer with schema evolution!
Writing a V2 Java Kafka Avro Consumer with schema evolution!
Summary for Compatibility Changes
Deep Dive to understand how the Schema Registry works behind the scenes
Learn how to efficiently manage schemas by having separate repositories for them
Introduction to understand what is the REST Proxy and what is its purpose
Understand the difference of the v1 vs the v2 API for the Confluent REST Proxy
Setup Insomnia on your Machine to have a REST Client
Understand how to list topics or view a specific topic's detail using the REST Proxy
Produce Binary data that's base64 encoded using the REST Proxy
Consume Binary data that's base64 decoded using the REST Proxy
Learn how to use the Confluent REST Proxy to produce data in JSON
Learn how to use the Confluent REST Proxy to consume data in JSON
Learn how to use the Confluent REST Proxy to produce data in Avro
Learn how to use the Confluent REST Proxy to consume data in Avro
End to End example for Avro, using Producer, Kafka Connect and Kafka Streams
Learn how to find documentation for the REST Proxy and how to Scale it in Production
Pointers for the next steps in your Kafka learning
Special coupons for my other Kafka Courses
OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.
Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.
Find this site helpful? Tell a friend about us.
We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.
Your purchases help us maintain our catalog and keep our servers humming without ads.
Thank you for supporting OpenCourser.