Handling Streaming Data with AWS Kinesis Data Analytics Using Java from Pluralsight

Kinesis Data Analytics is a service to transform and analyze streaming data with Apache Flink and SQL using serverless technologies. You'll learn to use the Amazon Kinesis Data Analytics service to process streaming data using Apache Flink runtime.

Kinesis Data Analytics is part of the Kinesis streaming platform along with Kinesis Data Streams, Kinesis Data Firehose, and Kinesis Video streams.

In this course, Handling Streaming Data with AWS Kinesis Data Analytics Using Java, you'll work with live Twitter feeds to process real-time streaming data. First, you'll create a developer account on the Twitter platform and generate authentication keys and tokens to access the Twitter streaming API. You'll then write code to access these tweets as streaming messages and publish them to Kinesis Data Streams which can be used as a source of streaming data in Kinesis Data Analytics.

Next, you'll run Kinesis Data Analytics applications using the Apache Flink runtime to process tweets. You'll deploy these applications using the web console as well as the command line. You'll set up the right permissions, and configure these applications to use cloud monitoring and logging, and see how you can use log messages to debug errors in your applications.

Finally, you'll perform a number of different processing operations on streaming tweets, windowing operations using tumbling and sliding windows. You'll apply global windows with count triggers, and continuous-time triggers. You'll implement join operations and create branching pipelines to sink some results to DynamoDB and other results to S3.

When you're finished with this course, you'll have the skills and knowledge to create and deploy streaming applications that process live streams such as Twitter messages.

What's inside

Syllabus

Course Overview

Handling Streaming Data Using the Apache Flink Runtime

Monitoring Jobs Using CloudWatch

Processing Twitter Feeds Using Windowing Operations

Processing Twitter Feeds Using Join Operations

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Teaches job configuration and troubleshooting for monitoring purposes

Introduces and explores Apache Flink for stream processing

Includes hands-on experience accessing and working with Twitter feeds

Suitable for learners with beginner-level experience in programming

Utilizes a combination of videos and readings for multi-modal learning

Introduces industry-standard technologies and methods

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Handling Streaming Data with AWS Kinesis Data Analytics Using Java with these activities:

Review core Java concepts

Show steps

Strengthen your programming skills by revisiting core Java concepts.

Browse courses on Java

Show steps

Go through your Java notes or textbooks.
Practice writing simple Java programs.
Solve Java coding challenges.

Run through Kinesis Data Analytics tutorials

Show steps

Reinforce your understanding of Kinesis Data Analytics concepts by completing the tutorials provided by AWS.

Browse courses on Kinesis Data Analytics

Show steps

Go through the Kinesis Data Analytics documentation.
Complete the Kinesis Data Analytics quickstart.
Work through the Kinesis Data Analytics tutorials.

Join a study group for Kinesis Data Analytics

Show steps

Enhance your understanding by discussing the course material with peers.

Browse courses on Kinesis Data Analytics

Show steps

Find a study group or create one with classmates.
Meet regularly to discuss course concepts and assignments.
Collaborate on projects and assignments.

Five other activities

Expand to see all activities and additional details

Show all eight activities

Explore additional Kinesis Data Analytics resources

Show steps

Expand your knowledge by seeking out further resources on Kinesis Data Analytics.

Browse courses on Kinesis Data Analytics

Show steps

Check out the Kinesis Data Analytics developer guide.
Watch videos and tutorials on Kinesis Data Analytics.
Read articles and blog posts about Kinesis Data Analytics.
Attend webinars and workshops on Kinesis Data Analytics.

Write a blog post about Kinesis Data Analytics

Show steps

Deepen your understanding of Kinesis Data Analytics by explaining it to others.

Browse courses on Kinesis Data Analytics

Show steps

Choose a specific topic related to Kinesis Data Analytics.
Research and gather information about the topic.
Write a detailed blog post that explains the topic clearly.
Proofread and edit your blog post.
Publish your blog post on a platform of your choice.

Help with open-source Kinesis Data Analytics projects

Show steps

Make a meaningful contribution while consolidating your knowledge by helping with Kinesis Data Analytics open-source projects.

Browse courses on Kinesis Data Analytics

Show steps

Find Kinesis Data Analytics projects on GitHub that need help.
Reach out to the project maintainers and offer your assistance.
Work on assigned tasks or issues.

Contribute to Kinesis Data Analytics projects

Show steps

Gain practical experience by contributing to Kinesis Data Analytics open-source projects.

Browse courses on Kinesis Data Analytics

Show steps

Find Kinesis Data Analytics projects on GitHub.
Identify an issue or feature to contribute to.
Fork the project and create a branch for your changes.
Make your changes and submit a pull request.

Mentor junior developers on Kinesis Data Analytics

Show steps

Solidify your understanding by mentoring others and sharing your knowledge.

Browse courses on Kinesis Data Analytics

Show steps

Identify opportunities to mentor junior developers.
Provide guidance and support on Kinesis Data Analytics concepts and projects.
Review their code and provide constructive feedback.

Career center

Learners who complete Handling Streaming Data with AWS Kinesis Data Analytics Using Java will develop knowledge and skills that may be useful to these careers:

Data Engineer

Data Engineers are responsible for designing, building, and maintaining the systems that store and process data. They work with data scientists and other stakeholders to understand the data needs of the organization and develop solutions to meet those needs. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill is essential for Data Engineers who want to work with streaming data.

See salaries and explore the career path for Data Engineer

Data Scientist

Data Scientists use data to solve business problems. They work with data engineers to access and process data, and then use statistical and machine learning techniques to extract insights from the data. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill is essential for Data Scientists who want to work with streaming data.

See salaries and explore the career path for Data Scientist

Software Engineer

Software Engineers design, develop, and maintain software applications. They work with stakeholders to understand the requirements of the application, and then develop and test the application to meet those requirements. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill is essential for Software Engineers who want to work with streaming data.

See salaries and explore the career path for Software Engineer

Cloud Architect

Cloud Architects design and manage cloud computing systems. They work with stakeholders to understand the needs of the organization and develop solutions to meet those needs. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill is essential for Cloud Architects who want to work with streaming data.

See salaries and explore the career path for Cloud Architect

Data Analyst

Data Analysts use data to help organizations make better decisions. They work with data engineers and data scientists to access and process data, and then use statistical and machine learning techniques to extract insights from the data. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill is essential for Data Analysts who want to work with streaming data.

See salaries and explore the career path for Data Analyst

Machine Learning Engineer

Machine Learning Engineers design and develop machine learning models. They work with data scientists and other stakeholders to understand the needs of the organization and develop solutions to meet those needs. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill is essential for Machine Learning Engineers who want to work with streaming data.

See salaries and explore the career path for Machine Learning Engineer

Big Data Engineer

Big Data Engineers design and manage big data systems. They work with stakeholders to understand the needs of the organization and develop solutions to meet those needs. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill is essential for Big Data Engineers who want to work with streaming data.

See salaries and explore the career path for Big Data Engineer

DevOps Engineer

DevOps Engineers are responsible for building and maintaining the infrastructure that supports software applications. They work with developers and operations teams to ensure that applications are deployed and running smoothly. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill is essential for DevOps Engineers who want to work with streaming data.

See salaries and explore the career path for DevOps Engineer

Data Architect

Data Architects design and manage the data architecture of an organization. They work with stakeholders to understand the needs of the organization and develop solutions to meet those needs. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill is essential for Data Architects who want to work with streaming data.

See salaries and explore the career path for Data Architect

Database Administrator

Database Administrators are responsible for managing and maintaining databases. They work with stakeholders to understand the needs of the organization and develop solutions to meet those needs. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill is essential for Database Administrators who want to work with streaming data.

See salaries and explore the career path for Database Administrator

IT Project Manager

IT Project Managers are responsible for planning and managing IT projects. They work with stakeholders to understand the needs of the organization and develop solutions to meet those needs. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill is essential for IT Project Managers who want to work with streaming data.

See salaries and explore the career path for IT Project Manager

Business Analyst

Business Analysts are responsible for analyzing business needs and developing solutions to meet those needs. They work with stakeholders to understand the needs of the organization and develop solutions to meet those needs. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill may be helpful for Business Analysts who want to work with streaming data.

See salaries and explore the career path for Business Analyst

Product Manager

Product Managers are responsible for planning and managing the development of products. They work with stakeholders to understand the needs of the organization and develop solutions to meet those needs. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill may be helpful for Product Managers who want to work with streaming data.

See salaries and explore the career path for Product Manager

Marketing Analyst

Marketing Analysts are responsible for analyzing marketing data and developing strategies to improve marketing campaigns. They work with stakeholders to understand the needs of the organization and develop solutions to meet those needs. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill may be helpful for Marketing Analysts who want to work with streaming data.

See salaries and explore the career path for Marketing Analyst

Sales Analyst

Sales Analysts are responsible for analyzing sales data and developing strategies to improve sales. They work with stakeholders to understand the needs of the organization and develop solutions to meet those needs. In this course, you will learn how to use Kinesis Data Analytics to process streaming data in real-time. This skill may be helpful for Sales Analysts who want to work with streaming data.

See salaries and explore the career path for Sales Analyst

Handling Streaming Data with AWS Kinesis Data Analytics Using Java

What's inside

Syllabus

Good to know

Save this course

Activities

Career center

Reading list

Share

Similar courses