OpenCourser brand icon
Sign in
We may earn an affiliate commission when you visit our partners.
Course image
Udemy logo

Apache Kafka Series - Confluent Schema Registry & REST Proxy

4.5 Filled star Filled star Filled star Filled star Half star
Based on 3,547 ratings
see reviews
Stephane Maarek | AWS Certified Cloud Practitioner,Solutions Architect,Developer and Conduktor Kafkademy

The new volume in the Apache Kafka Series.

Learn Apache Avro, the Confluent Schema Registry for Apache Kafka and the Confluent REST Proxy for Apache Kafka. Join hundreds of knowledge savvy students into learning some of the most important components in a typical Apache Kafka stack.

Take a look at these student reviews...

5 stars - "Excellent course. A must for Apache Kafka users." – Mayank

Read more

The new volume in the Apache Kafka Series.

Learn Apache Avro, the Confluent Schema Registry for Apache Kafka and the Confluent REST Proxy for Apache Kafka. Join hundreds of knowledge savvy students into learning some of the most important components in a typical Apache Kafka stack.

Take a look at these student reviews...

5 stars - "Excellent course. A must for Apache Kafka users." – Mayank

5 stars -"Beautiful explanation of Avro and how to use it with Apache Kafka. This knowledge enhancing like all your other courses. We have Apache Kafka from Confluent in our enterprise and this is what I was exactly looking for. Thanks a lot." – Vinod

5 stars - "Stephane Maarek is truly remarkable instructor. His instructional videos do not disappoint, they keep me wanting more and provide exactly the Kafka skills needed to be successful." – Troy

Apache Avro is one of the most powerful and most popular fast data serialisation mechanism with Apache Kafka

> Schema is a first class citizen of the data> Data serialisation format that is lightweight> Documentation is embedded in the schema> Easy to read and write using many languages> Fast & Big data de-facto data serialisation format

Confluent Schema Registry for Apache Kafka is the de-facto standard way of storing Avro Schemas for your Apache Kafka Topics.

> Stores a versioned history of all your schemas in Apache Kafka> Supports and enforces conditions for schema evolution (backward, forward, full compatibility)> Kafka Avro Serialiser and Deserialiser automatically integrate with Apache Kafka and Confluent Schema Registry> Make your messages much smaller and lighter. Perfect for increasing Apache Kafka throughput and performance

Confluent REST Proxy is the perfect way to communicate for sending Avro data using non Java languages to Apache Kafka. 

> Write and Read binary, JSON and Avro data to Apache Kafka using an HTTP REST API> Interact with Apache Kafka using any programming language (not just Java)> Consult topic list and topic metadata in Apache Kafka

Hands On & Theory Based Course

Note: This course is comprehensive, and the Apache Kafka related bits do not start before the Kafka Schema Registry section. This is to ensure Avro Schema and Avro in Java is fully understood before moving to the Confluent Schema Registry for Apache Kafka. 

This course is the first and only available Kafka Schema Registry and Kafka REST Proxy course on the web. Get it now to become an Apache Kafka expert.

Instructor

My name is Stephane Maarek, and I'll be your instructor in this course. I teach about Apache Kafka, the Kafka ecosystem and Kafka Certifications with my focus always on helping my students improve their professional proficiencies. I am also the co-founder of Conduktor: an enterprise Apache Kafka platform & UI to help everyone use Kafka.

Throughout my career in designing and delivering these certifications and courses, I have already taught

With Apache Kafka becoming much more than a buzzword out there, I've decided it's time for students to properly learn how to be a Kafka professional. So, let’s kick start the course. You are in good hands.

This Course Also Comes With:

  • Lifetime Access to All Future Updates

  • A responsive instructor in the Q&A Section

  • Links to interesting articles, and lots of good code to base your next applications onto

  • Udemy Certificate of Completion Ready for Download

This is the course that could improve your career.

Apache Kafka is a skill in high demand and there are not enough people to fulfill all the open positions. You can boost your income, take on new roles and fun challenges. Many of my students are now the Kafka experts of their companies. You can be the next.

I hope to see you inside the course.

Note: Looking for more advanced Kafka concepts? There are many volumes in the Apache Kafka Series:

  • Learn Kafka for Beginners v2 (great to start)

  • Kafka Connect Hands On Learning

  • Kafka Streams for Data Processing

  • KSQL on ksqlDB - Hands On.

  • Kafka Cluster Setup & Administration

  • Confluent Schema Registry & Kafka REST Proxy

  • Kafka Security (

Enroll now

What's inside

Learning objectives

  • Write simple and complex avro schemas
  • Create, write and read avro objects in java
  • Write a java producer and consumer leveraging avro data and the schema registry
  • Learn about schema evolution
  • Perform schema evolution using the command line and in java
  • Utilize the rest proxy using a rest client

Syllabus

Let's learn why we need Schema, and what the target architecture will look like.

Short introduction that describes the need of a Schema Registry in Kafka

Read more

Learn about the course objectives and how the course is structure

Learn about Stephane Maarek, your instructor for this course

Visit the target architecture with Apache Kafka, the Confluent Schema Registry and the REST Proxy

Download all the code and tools for the course

Learn what Apache Avro is and how it came to be

Learn the Apache Avro primitive types

Learn how to define a Record Apache Avro Schema

Learn what are the Complex types for Apache Avro

Practice your newly acquired skills by creating a Customer and CustomerAddress Schema

Learn what are the possible Apache Avro logical types

Learn how to handle decimal numbers in Avro

Links to various Avro Schemas you can find on the web

Summary of all the things we have learned so far

Understand what we're trying to achieve with Avro in Java

Learn how to create a GenericRecord in Avro

Learn how to create a SpecificRecord in Avro

Check point to understand where we are now vs later when using Kafka

Hands-On practice with the Avro tools

Learn how to generate an Avro schema using Avro Reflection

Learn the theory behind schema evolution

Get Hands-On with Schema Evolution in Java

Section summary to understand how we used Java and Apache Avro library to build Avro objects.

Important information regarding the installation process

Install Docker for Mac if you have a recent Mac machine

Install Docker Toolbox on Mac if you have an older machine

Install Docker on Linux

Install Docker on recent Windows 10 64bit

Install Docker Toolbox on other Windows version

Increase the RAM for Docker

Frequently asked and common issues for Docker and Kafka Setup

Start our Kafka Cluster using Docker Compose

Introduction to the Confluent Schema Registry

Learn how to use the Kafka Avro Console Producer and Consumer

Learn how to use Java to write your first Avro Producer

Learn how to write an Avro consumer using Java

Re-visit what Schema Evolution is before we perform it in Java

Writing a V2 Java Kafka Avro Producer with schema evolution!

Writing a V2 Java Kafka Avro Consumer with schema evolution!

Summary for Compatibility Changes

Deep Dive to understand how the Schema Registry works behind the scenes

Learn how to efficiently manage schemas by having separate repositories for them

Introduction to understand what is the REST Proxy and what is its purpose

Understand the difference of the v1 vs the v2 API for the Confluent REST Proxy

Setup Insomnia on your Machine to have a REST Client

Understand how to list topics or view a specific topic's detail using the REST Proxy

Produce Binary data that's base64 encoded using the REST Proxy

Consume Binary data that's base64 decoded using the REST Proxy

Learn how to use the Confluent REST Proxy to produce data in JSON

Learn how to use the Confluent REST Proxy to consume data in JSON

Learn how to use the Confluent REST Proxy to produce data in Avro

Learn how to use the Confluent REST Proxy to consume data in Avro

End to End example for Avro, using Producer, Kafka Connect and Kafka Streams

Learn how to find documentation for the REST Proxy and how to Scale it in Production

Pointers for the next steps in your Kafka learning

Special coupons for my other Kafka Courses

Traffic lights

Read about what's good
what should give you pause
and possible dealbreakers
Develops in-demand Apache Kafka skills for career advancement
Taught by a recognized expert in Apache Kafka and the Kafka ecosystem
Provides a comprehensive study of Apache Avro, Confluent Schema Registry, and Confluent REST Proxy
Hands-on labs and interactive materials strengthen learning
Builds a solid foundation for beginners in Apache Kafka
May require additional setup and software, which could be a barrier for some students

Save this course

Create your own learning path. Save this course to your list so you can find it easily later.
Save

Reviews summary

Mastering kafka schema registry & rest proxy

According to learners, this course offers a highly valuable and comprehensive deep dive into Apache Avro, Confluent Schema Registry, and REST Proxy, essential components for a robust Kafka ecosystem. Students praise the instructor's exceptionally clear explanations and the course's hands-on practical approach, featuring useful demos and code examples that are directly applicable to real-world scenarios. While beneficial for career-focused professionals, students note that a foundational understanding of Kafka enhances the learning experience, as the course quickly progresses into advanced topics. It stands out as a unique and up-to-date resource for these specialized subjects.
Provides skills directly applicable to enterprise Kafka environments.
"This knowledge truly enhanced my understanding, especially since we heavily use Confluent Kafka in our enterprise environment."
"I believe this course will significantly boost my income and enable me to take on new, challenging roles in my career."
"The skills taught here are highly in-demand, making me more proficient and confident in my role as a Kafka professional."
Covers specialized Kafka components like Schema Registry and REST Proxy thoroughly.
"This course was exactly what I was looking for regarding Confluent Schema Registry and REST Proxy, very in-depth and specific."
"It's great to find what appears to be the first and only available course specifically on Kafka Schema Registry and REST Proxy."
"The detailed breakdown of Avro, Schema Registry, and REST Proxy is invaluable for anyone working with enterprise Kafka setups."
Offers practical examples and code to apply concepts directly.
"The hands-on coding and projects are the strongest part of the course for me, really helping solidify my understanding."
"I got a lot of good code from this course that I can directly use to build my next applications. Very practical."
"The course balances theory with extensive practical applications and demos, which made it highly valuable for real-world use."
The instructor provides highly clear and concise explanations.
"The explanations of Avro and its use with Apache Kafka were beautiful, making complex concepts easy to grasp."
"I found Stephane Maarek a truly remarkable instructor; his instructional videos deliver exactly the Kafka skills needed."
"This course is excellent; the instructor's teaching style keeps me wanting more and clarifies tough topics effectively."
Beneficial for learners with some prior understanding of Apache Kafka.
"I found it very helpful to have some foundational Kafka knowledge before diving into this course, as it progresses quickly."
"Be aware that the Kafka-related bits don't start until the Schema Registry section, so basic Kafka is a prerequisite."
"Given it's part of a series, I'd recommend completing a beginner Kafka course first if you're new to the ecosystem."

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Apache Kafka Series - Confluent Schema Registry & REST Proxy with these activities:
Organize your course materials
Improve engagement and retention by organizing your notes, assignments, and other course materials in a logical and accessible manner.
Show steps
  • Gather all course materials
  • Create folders and subfolders to categorize materials
  • Use a note-taking app or notebook to organize notes
  • Archive assignments and quizzes for future reference
Compile a list of Kafka resources
Consolidate valuable Kafka resources, such as articles, tutorials, and tools, for easy reference.
Browse courses on Apache Kafka
Show steps
  • Search for high-quality Kafka resources
  • Organize resources into categories
  • Create a document or spreadsheet to store the compilation
  • Share the compilation with other learners
Practice writing Avro Schemas
Apache Avro is a crucial component of Kafka. Practice writing schemas to improve your understanding and proficiency.
Show steps
  • Review the Avro Schema syntax and primitive types
  • Create a simple Avro Schema for a customer record
  • Define a complex Avro Schema with nested records and arrays
  • Handle decimal numbers using Avro logical types
  • Generate an Avro schema using Avro Reflection
Five other activities
Expand to see all activities and additional details
Show all eight activities
Experiment with the Avro tools
The Avro tools provide powerful command-line utilities. Practice using them to validate and manage schemas.
Show steps
  • Install the Avro tools
  • Use avsc to validate Avro Schemas
  • Use avro-tools to generate Java classes from Avro Schemas
  • Utilize the Schema Registry API to manage schemas
Explore the REST Proxy documentation
The REST Proxy is a valuable tool for interacting with Kafka using non-Java languages. Explore the documentation to enhance your understanding.
Show steps
  • Visit the Confluent REST Proxy documentation website
  • Review the tutorials and examples for using the REST API
  • Understand the different endpoints and request formats
  • Identify how to perform common operations like producing and consuming data
Attend a Kafka Meetup
Connect with fellow Kafka enthusiasts and professionals to share experiences and learn about the latest developments.
Browse courses on Apache Kafka
Show steps
  • Find a local Kafka Meetup group
  • Attend a Meetup event
  • Engage in discussions and ask questions
  • Network with other attendees
Build a small-scale Kafka application
Apply your knowledge by building a practical Kafka application that addresses a specific use case.
Browse courses on Apache Kafka
Show steps
  • Define the scope and requirements of the application
  • Design the Kafka architecture for the application
  • Implement the Kafka producer and consumer components
  • Test and deploy the application
Contribute to the Kafka ecosystem
Deepen your understanding of Kafka by contributing to open-source projects related to the ecosystem.
Show steps
  • Identify an open-source project related to Kafka
  • Review the project's documentation and codebase
  • Identify an area where you can contribute
  • Submit a pull request with your contribution

Career center

Learners who complete Apache Kafka Series - Confluent Schema Registry & REST Proxy will develop knowledge and skills that may be useful to these careers:

Reading list

We haven't picked any books for this reading list yet.

Share

Help others find this course page by sharing it with your friends and followers:
Facebook
LinkedIn
Reddit
X
Link
Email

Similar courses

Similar courses are unavailable at this time. Please try again later.
Course image
Rating
4.5 Filled star Filled star Filled star Filled star Half star
Effort
4.5 total hours
Via
Udemy
Instructors
Stephane Maarek | AWS Certified Cloud Practitioner,Solutions Architect,Developer
Conduktor Kafkademy
Language
English
Traffic lights
Read about what's good
what should give you pause
and possible dealbreakers
Develops in-demand Apache Kafka skills for career advancement
Taught by a recognized expert in Apache Kafka and the Kafka ecosystem
Provides a comprehensive study of Apache Avro, Confluent Schema Registry, and Confluent REST Proxy
Hands-on labs and interactive materials strengthen learning
Builds a solid foundation for beginners in Apache Kafka
May require additional setup and software, which could be a barrier for some students
Share this
Share to help others discover this course.
Facebook LinkedIn X Reddit Link Email
Begin learning today
Enroll now to gain full access to Apache Kafka Series - Confluent Schema Registry & REST Proxy.
Enroll now
Save for later
Add this course to your list. Find it anytime.
Save
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2025 OpenCourser