Building an Enterprise Grade Distributed Online Analytics Platform from Pluralsight

In this course, you'll develop an understanding for analytics capabilities, and you'll learn how to build a full-blown, wholistic, distributed analytics system using Kafka, Cassandra, Storm, and Elasticsearch.

In this course, Building an Enterprise Grade Distributed Online Analytics Platform, you'll learn how to build a full-blown distributed analytics system using Kafka, Cassandra, Storm, and Elasticsearch. First, you'll begin by understanding what is online analytics and how it differs from offline analytics. You'll further discuss and analyze the parts of a modern online analytics system, including the data backbone, storage, processing, and insight generation. Next, you'll develop an understanding of your choice of technology, its features, and why it was chosen for a specific task. Finally, you'll explore how to properly integrate the technology into your solution in a manner that's most beneficial. Each technology you use will be placed under an observant eye, and you'll see how each technology provides scalability, fault tolerance, and most importantly how it contributes in achieving the functionality you desire. By the end of this course, you'll be ready to immediately enrich your enterprise with amazing analytics capabilities.

What's inside

Syllabus

Course Overview

Introduction to Online BigData Analytics

Utilizing Apache Kafka as a Data Backbone

Introducing Distributed Computation with Apache Storm

Integrating Apache Cassandra as Our Distributed Database

Gathering Insights with Elasticsearch

Summary

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Explores big data technologies and online analytics, which are foundational topics within data engineering

Provides an understanding of the architecture and concepts behind data backbone, storage, processing, and insights generation which are core competencies of a data engineer

Taught by Kobi Hikri, who is an experienced technology professional and instructor, adding credibility to the course

Instruction is multi-modal, including videos, discussions, and readings, which supports diverse learner preferences

Explores industry-standard tools like Kafka, Cassandra, Storm, and Elasticsearch, which are highly relevant to this field

Helps learners develop skills in Apache Kafka, Apache Storm, and Apache Cassandra, which are currently in demand in the job market

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Building an Enterprise Grade Distributed Online Analytics Platform with these activities:

Attend online meetups on big data and distributed systems

Show steps

Expand your professional network and stay up-to-date with industry trends by attending online meetups focused on big data and distributed systems, connecting with experts and learning about real-world applications.

Browse courses on Big Data

Show steps

Find relevant meetups
Register and attend the meetups
Engage with other attendees

Review Kafka architecture

Show steps

Refine your understanding of Kafka's architecture to strengthen your foundation for building distributed analytics systems.

Browse courses on Apache Kafka

Show steps

Read Kafka documentation
Review Kafka tutorials
Create a simple Kafka cluster
Explore Kafka's APIs

Follow tutorials on Cassandra NoSQL database

Show steps

Expand your knowledge by exploring Cassandra's capabilities through guided tutorials, gaining practical experience with this distributed database.

Browse courses on Apache Cassandra

Show steps

Find tutorials on Cassandra
Choose a tutorial and follow the steps
Experiment with Cassandra commands

Five other activities

Expand to see all activities and additional details

Show all eight activities

Solve LeetCode problems on data structures and algorithms

Show steps

Strengthen your problem-solving abilities by tackling LeetCode challenges, improving your analytical thinking and coding skills, which are crucial for building analytics systems.

Browse courses on Data Structures

Show steps

Choose a problem set
Attempt to solve the problems
Review solutions and learn from mistakes

Build a mini event streaming pipeline with Kafka

Show steps

Solidify your grasp of Kafka by constructing a small-scale event streaming pipeline that demonstrates data ingestion, processing, and consumption.

Show steps

Choose a data source
Set up Kafka and connect the data source
Write a simple data consumer
Monitor and debug the pipeline

Develop a data visualization dashboard using Elasticsearch

Show steps

Showcase your skills by creating a data visualization dashboard that leverages Elasticsearch's capabilities, enhancing your understanding of data analysis and presentation.

Show steps

Choose a dataset
Design the dashboard layout
Implement data visualizations
Deploy and configure the dashboard

Write a blog post on distributed analytics with Kafka

Show steps

Deepen your understanding by explaining distributed analytics concepts using Kafka in a written format, reinforcing your knowledge and potentially helping others.

Show steps

Identify key concepts
Research and gather information
Write and edit the blog post

Contribute to open-source projects related to Kafka or Cassandra

Show steps

Immerse yourself in real-world applications by contributing to open-source projects that use Kafka or Cassandra, gaining hands-on experience and expanding your network.

Show steps

Find a project to contribute to
Understand the project's codebase and objectives
Identify areas for improvement
Implement and test your contributions

Career center

Learners who complete Building an Enterprise Grade Distributed Online Analytics Platform will develop knowledge and skills that may be useful to these careers:

Data Engineer

Data Engineers build and maintain data systems. They ensure that these systems are able to collect, store, and process data. This course can help you develop the skills and knowledge you need to become a Data Engineer. You will learn about the different components of a data system, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course will also help you develop the skills you need to manage a data system, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Data Engineer

Data Scientist

Data Scientists use data to solve business problems. They develop and implement data-driven solutions. This course can help you develop the skills and knowledge you need to become a Data Scientist. You will learn about the different components of a data system, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course will also help you develop the skills you need to manage a data system, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Data Scientist

Data Architect

Data Architects design and manage data systems. They ensure that these systems are able to meet the needs of the business. This course can help you develop the skills and knowledge you need to become a Data Architect. You will learn about the different components of a data system, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course will also help you develop the skills you need to manage a data system, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Data Architect

Cloud Architect

Cloud Architects design and manage cloud computing systems. They ensure that these systems are scalable, reliable, and secure. This course can help you develop the skills and knowledge you need to become a Cloud Architect. You will learn about the different components of a cloud computing system, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course will also help you develop the skills you need to manage a cloud computing system, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Cloud Architect

DevOps Engineer

DevOps Engineers work with both development and operations teams to ensure that software is developed and deployed smoothly. They are responsible for building and maintaining the infrastructure that supports the software development process. This course can help you develop the skills and knowledge you need to become a DevOps Engineer. You will learn about the different components of a software development system, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course will also help you develop the skills you need to manage a software development system, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for DevOps Engineer

Full-Stack Developer

Full-Stack Developers are responsible for the entire software development process, from design to deployment. They work with both front-end and back-end technologies. This course can help you develop the skills and knowledge you need to become a Full-Stack Developer. You will learn about the different components of a software development system, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course will also help you develop the skills you need to manage a software development system, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Full-Stack Developer

IT Manager

IT Managers plan and manage the technology resources of an organization. They are responsible for ensuring that these resources are used effectively and efficiently. This course can help you develop the skills and knowledge you need to become an IT Manager. You will learn about the different components of an IT system, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course will also help you develop the skills you need to manage an IT system, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for IT Manager

Network Engineer

Network Engineers design and maintain computer networks. They ensure that these networks are reliable and secure. This course may help you develop the skills and knowledge you need to become a Network Engineer. You will learn about the different components of a computer network, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course may also help you develop the skills you need to manage a computer network, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Network Engineer

Security Analyst

Security Analysts protect computer systems from unauthorized access and attack. They develop and implement security measures to ensure that these systems are protected from threats. This course may help you develop the skills and knowledge you need to become a Security Analyst. You will learn about the different components of a computer system, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course may also help you develop the skills you need to manage a computer system, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Security Analyst

Project Manager

Project Managers plan and execute projects. They are responsible for ensuring that projects are completed on time, within budget, and to the required quality standards. This course may help you develop the skills and knowledge you need to become a Project Manager. You will learn about the different components of a project, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course may also help you develop the skills you need to manage a project, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Project Manager

Software Developer

Software Developers design and develop software applications. They work with both front-end and back-end technologies. This course can help you develop the skills and knowledge you need to become a Software Developer. You will learn about the different components of a software application, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course will also help you develop the skills you need to manage a software application, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Software Developer

Web Developer

Web Developers design and develop websites. They work with both front-end and back-end technologies. This course may help you develop the skills and knowledge you need to become a Web Developer. You will learn about the different components of a website, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive website. This course may also help you develop the skills you need to manage a website, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Web Developer

Systems Analyst

Systems Analysts design and implement computer systems. They work with both hardware and software to ensure that these systems meet the needs of the business. This course can help you develop the skills and knowledge you need to become a Systems Analyst. You will learn about the different components of a computer system, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive system. This course will also help you develop the skills you need to manage a computer system, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Systems Analyst

Technical Writer

Technical Writers create user manuals, technical documents, and other materials to explain technical concepts. This course may help you develop the skills and knowledge you need to become a Technical Writer. You will learn about the different components of a technical document, including data backbones, storage, processing, and insight generation. You will also learn how to integrate these components into a single, cohesive document. This course may also help you develop the skills you need to manage a technical document, including monitoring, troubleshooting, and scaling.

See salaries and explore the career path for Technical Writer