OpenCourser brand icon
Sign in
We may earn an affiliate commission when you visit our partners.

Big Data Applications

Real-Time Streaming

Ivan Puzyrevskiy, Pavel Mezentsev, Emeli Dral, Alexey A. Dral, Artyom Vybornov, Vladislav Goncharenko, and Ivan Mushketyk
There is a significant number of tasks when we need not just to process an enormous volume of data but to process it as quickly as possible. Delays in tsunami prediction can cost people’s lives. Delays in traffic jam prediction cost extra time. Advertisements based on the recent users’ activity are ten times more popular. However, stream processing techniques alone are not enough to create a complete real-time system. For example to create a recommendation system we need to have a storage that allows to store and fetch data for a user with minimal latency. These databases should be able to store hundreds of terabytes of data,...
Read more
There is a significant number of tasks when we need not just to process an enormous volume of data but to process it as quickly as possible. Delays in tsunami prediction can cost people’s lives. Delays in traffic jam prediction cost extra time. Advertisements based on the recent users’ activity are ten times more popular. However, stream processing techniques alone are not enough to create a complete real-time system. For example to create a recommendation system we need to have a storage that allows to store and fetch data for a user with minimal latency. These databases should be able to store hundreds of terabytes of data, handle billions of requests per day and have a 100% uptime. NoSQL databases are commonly used to solve this challenging problem. After you finish this course, you will master stream processing systems and NoSQL databases. You will also learn how to use such popular and powerful systems as Kafka, Cassandra and Redis. To get the most out of this course, you need to know Hadoop and SQL. You should also have a working knowledge of bash, Python and Spark. Do you want to learn how to build Big Data applications that can withstand modern challenges? Jump right in!
This course is no longer available. Find a similar course by searching these:
real-time data processing big data applications hadoop systems apache cassandra nosql databases stream processing

Good to know

Know what's good
, what to watch for
, and possible dealbreakers
Teaches stream processing systems and NoSQL databases, which may be valuable in meeting industry demands for fast data processing
Taught by a team with notable instructors in the field, such as Pavel Mezentsev and Alexey A. Dral
Utilizes widely adopted systems such as Kafka, Cassandra, and Redis, enhancing its practical relevance
Requires prerequisites in Hadoop, SQL, bash, Python, and Spark, potentially limiting accessibility for beginners

Save this course

Save Big Data Applications: Real-Time Streaming to your list so you can find it easily later:
Save

Reviews summary

Disappointing big data course

From the one review of this course, students found that the tools and assignments given were lackluster and, in the case of the first week’s assignment, impossible to complete within any reasonable time frame.

Activities

Coming soon We're preparing activities for Big Data Applications: Real-Time Streaming. These are activities you can do either before, during, or after a course.

Career center

Learners who complete Big Data Applications: Real-Time Streaming will develop knowledge and skills that may be useful to these careers:
Data Engineer
Data Engineers help improve the performance of data pipelines and databases and develop tools that data scientists and analysts can use to run machine learning models and generate business insights. This course provides a foundation in stream processing systems, NoSQL databases, Kafka, Cassandra, and Redis, all of which are essential technologies for Data Engineers to master.
See salaries and explore the career path for Data Engineer
Data Scientist
Data Scientists contribute to the design and implementation of data processing pipelines that transform raw data into actionable insights. This course can help Data Scientists gain proficiency in processing large volumes of streaming data and storing and retrieving data with minimal latency, which are critical skills for building real-time data-driven applications.
See salaries and explore the career path for Data Scientist
Database Administrator
Database Administrators ensure that databases are operating smoothly and efficiently. This course provides a deep dive into NoSQL databases, which are commonly used for storing and managing large volumes of data in real-time applications. By gaining expertise in these technologies, individuals can enhance their ability to design, implement, and manage scalable and high-performance database systems.
See salaries and explore the career path for Database Administrator
Software Engineer
Software Engineers design, develop, and maintain software applications. This course can help Software Engineers build real-time data processing applications that can handle large volumes of streaming data. The course covers stream processing systems, NoSQL databases, Kafka, Cassandra, and Redis, which are essential technologies for developing scalable and fault-tolerant software systems.
See salaries and explore the career path for Software Engineer
Data Analyst
Data Analysts collect, clean, and analyze data to identify trends and patterns. This course provides a foundation in stream processing systems and NoSQL databases, which are essential technologies for Data Analysts who want to work with real-time data. By gaining expertise in these technologies, individuals can enhance their ability to analyze streaming data and generate actionable insights.
See salaries and explore the career path for Data Analyst
Systems Engineer
Systems Engineers design, implement, and maintain complex computer systems. This course can help Systems Engineers build and manage scalable and fault-tolerant systems that can handle large volumes of streaming data. The course covers stream processing systems, NoSQL databases, Kafka, Cassandra, and Redis, which are essential technologies for designing and implementing high-performance systems.
See salaries and explore the career path for Systems Engineer
Cloud Architect
Cloud Architects design and manage cloud-based infrastructure and applications. This course provides a foundation in stream processing systems and NoSQL databases, which are essential technologies for building real-time data processing applications in the cloud. By gaining expertise in these technologies, individuals can enhance their ability to design and implement scalable and fault-tolerant cloud-based systems.
See salaries and explore the career path for Cloud Architect
Business Analyst
Business Analysts help businesses understand their data and make better decisions. This course can help Business Analysts build a foundation in stream processing systems and NoSQL databases, which are essential technologies for analyzing real-time data. By gaining expertise in these technologies, individuals can enhance their ability to identify trends and patterns in data and provide valuable insights to businesses.
See salaries and explore the career path for Business Analyst
Data Warehouse Engineer
Data Warehouse Engineers design and manage data warehouses, which are used to store and analyze large volumes of data. This course can help Data Warehouse Engineers build a foundation in stream processing systems and NoSQL databases, which are essential technologies for building real-time data warehouses. By gaining expertise in these technologies, individuals can enhance their ability to design and implement scalable and fault-tolerant data warehouses.
See salaries and explore the career path for Data Warehouse Engineer
DevOps Engineer
DevOps Engineers bridge the gap between development and operations teams. This course can help DevOps Engineers build a foundation in stream processing systems and NoSQL databases, which are essential technologies for building and managing real-time data pipelines. By gaining expertise in these technologies, individuals can enhance their ability to design and implement scalable and fault-tolerant data pipelines.
See salaries and explore the career path for DevOps Engineer
Information Security Analyst
Information Security Analysts protect computer systems and networks from unauthorized access and attacks. This course can help Information Security Analysts build a foundation in stream processing systems and NoSQL databases, which are essential technologies for detecting and responding to security threats in real-time. By gaining expertise in these technologies, individuals can enhance their ability to design and implement secure systems and networks.
See salaries and explore the career path for Information Security Analyst
Machine Learning Engineer
Machine Learning Engineers develop and deploy machine learning models. This course can help Machine Learning Engineers build a foundation in stream processing systems and NoSQL databases, which are essential technologies for building and managing real-time machine learning models. By gaining expertise in these technologies, individuals can enhance their ability to design and implement scalable and fault-tolerant machine learning models.
See salaries and explore the career path for Machine Learning Engineer
Software Architect
Software Architects design and develop software systems. This course can help Software Architects build a foundation in stream processing systems and NoSQL databases, which are essential technologies for building scalable and fault-tolerant software systems. By gaining expertise in these technologies, individuals can enhance their ability to design and implement complex software systems.
See salaries and explore the career path for Software Architect
IT Project Manager
IT Project Managers plan and execute IT projects. This course can help IT Project Managers build a foundation in stream processing systems and NoSQL databases, which are essential technologies for managing real-time data projects. By gaining expertise in these technologies, individuals can enhance their ability to plan and execute successful IT projects.
See salaries and explore the career path for IT Project Manager
Data Privacy Officer
Data Privacy Officers develop and implement policies and procedures to protect personal data. This course can help Data Privacy Officers build a foundation in stream processing systems and NoSQL databases, which are essential technologies for managing and protecting real-time data. By gaining expertise in these technologies, individuals can enhance their ability to develop and implement effective data privacy policies and procedures.
See salaries and explore the career path for Data Privacy Officer

Reading list

We haven't picked any books for this reading list yet.

Share

Help others find this course page by sharing it with your friends and followers:
Facebook
LinkedIn
Reddit
X
Link
Email

Similar courses

Similar courses are unavailable at this time. Please try again later.
Time
26 hours
Via
Coursera
Institution
Yandex
Instructors
Ivan Puzyrevskiy
Pavel Mezentsev
Emeli Dral
Alexey A. Dral
Artyom Vybornov
Vladislav Goncharenko
Ivan Mushketyk
This course belongs to a collection called Big Data for Data Engineers. It's comprised of five courses:
  1. Big Data Services: Capstone Project
  2. Big Data Applications: Machine Learning at Scale
  3. Big Data Applications: Real-Time Streaming (viewing)
  4. Big Data Essentials: HDFS, MapReduce and Spark RDD
  5. Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
Good to know
Teaches stream processing systems and NoSQL databases, which may be valuable in meeting industry demands for fast data processing
Taught by a team with notable instructors in the field, such as Pavel Mezentsev and Alexey A. Dral
Utilizes widely adopted systems such as Kafka, Cassandra, and Redis, enhancing its practical relevance
Requires prerequisites in Hadoop, SQL, bash, Python, and Spark, potentially limiting accessibility for beginners
Share and help others discover this course.
Facebook LinkedIn X Reddit Link Email
Don't miss out
Enroll today to gain access to this course
Enroll in this course
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2025 OpenCourser