In this course, you will be introduced to the data engineering lifecycle, from data generation in source systems, data ingestion, data transformation, storage, all the way to serving data to downstream stakeholders. You’ll take note of the key undercurrents that affect all stages of the lifecycle, and start developing a framework for how to think like a data engineer.
In this course, you will be introduced to the data engineering lifecycle, from data generation in source systems, data ingestion, data transformation, storage, all the way to serving data to downstream stakeholders. You’ll take note of the key undercurrents that affect all stages of the lifecycle, and start developing a framework for how to think like a data engineer.
To gain hands-on practice, you’ll gather stakeholder needs, translate those needs into system requirements, and choose tools and technologies to build systems that provide business value. You’ll also build an end-to-end data system that encompasses all stages of the data engineering lifecycle, dive into some of the details of batch and streaming pipelines to serve data for a product recommendation system, and apply principles of good data architecture to assess the security, performance, reliability, and scalability of a web app hosted on AWS.
Verified partner policies & purchase protections
7-day free trial on monthly Coursera Plus subscriptions; free audit option available on most individual courses to explore video lectures and readings at no charge.
14-day refund window on annual Coursera Plus subscriptions and single-course purchases prior to certificate issuance. Monthly subscriptions do not offer refunds once billed.
Accredited university and industry certifications (e.g. Stanford, Google, IBM, Yale), secure SSL payment processing, and verifiable digital certificate links.
OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.
Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.
Find this site helpful? Tell a friend about us.
We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.
Your purchases help us maintain our catalog and keep our servers humming without ads.
Thank you for supporting OpenCourser.