We may earn an affiliate commission when you visit our partners.
Course image
Alfredo Deza

In this course, part of the Python, Bash and SQL Essentials for Data Engineering Specialization, you will gain the skills to work effectively with data using Python and SQL. You will learn to:

Read more

In this course, part of the Python, Bash and SQL Essentials for Data Engineering Specialization, you will gain the skills to work effectively with data using Python and SQL. You will learn to:

  • Leverage Python's powerful data structures to load, manipulate, and analyze data
  • Create robust Python scripts to automate data processing tasks
  • Utilize SQLite to store and retrieve data from within your Python scripts
  • Extract data from websites using web scraping techniques and persist it in databases
  • Work with MySQL databases using modern tools like VSCode to execute queries and manage data

Whether you are a data engineer, analyst, or aspiring data professional, this course will equip you with the essential skills to efficiently handle data and drive meaningful insights in today's data-driven world.

What's inside

Learning objectives

  • Manipulate data using python's built-in data structures
  • Create python scripts to automate data tasks
  • Use sqlite to store and query data in python
  • Extract data from websites via web scraping
  • Execute mysql queries and operations in vscode
  • Import and export data in mysql databases

Syllabus

Here is the course structure formatted with bullets for each module:
Module 1: Working with Data in Python (5 hours)
\- Videos (Total 62 minutes):
Read more

Traffic lights

Read about what's good
what should give you pause
and possible dealbreakers
Designed for beginners, this course lays the foundational knowledge and core skills for those seeking to enter the field of data engineering
Taught by experienced professionals in data engineering, this course conveys real-world applications and practical techniques
Delves into the practical applications of Python, Bash, and SQL, equipping learners with industry-standard tools for data analysis and engineering
May require supplemental learning for those with limited programming experience, as it assumes some prior knowledge

Save this course

Create your own learning path. Save this course to your list so you can find it easily later.
Save

Reviews summary

Practical python and sql for data engineering

According to students, this course receives largely positive feedback, consistently praised for its practical, real-world applicability and effective instruction. Learners particularly value the hands-on labs and the comprehensive coverage of essential topics like Python scripting, SQLite, web scraping, and MySQL. While many find the course well-structured and foundational for data engineering, some reviewers noted the pace can be fast and it may assume prior Python knowledge, making it more suitable for those with a basic understanding than complete beginners.
Provides a solid base in Python, SQL, and web scraping.
"Offers an excellent foundational understanding for aspiring data engineers."
"The course comprehensively covers essential tools like SQLite, MySQL, and web scraping."
"I now have a solid foundation in scripting and database integration for data engineering roles."
Instructor provides clear, concise, and knowledgeable explanations.
"The instructor is clear, concise, and explains complex concepts really well."
"Alfredo Deza is fantastic; his explanations are easy to follow and very helpful."
"I found the instructor very effective in conveying the core ideas of the course."
Labs are highly effective for reinforcing concepts.
"The hands-on labs effectively reinforce learning, making the concepts stick."
"The Jupyter notebooks and practical projects are the strongest part of the course for me."
"I appreciated the ungraded labs; they were key to solidifying my understanding of the material."
Delivers immediately applicable skills for data engineering.
"This course is very practical and immediately applicable to real-world scenarios."
"Extremely useful. It covers scripting, databases, and offers real-world applications."
"I learned how to automate data processing tasks, which has been incredibly useful in my work."
Course pace can be fast, requiring prior Python and SQL basics.
"I felt the course was rushed, and some explanations were superficial, requiring prior Python knowledge."
"This course assumes too much prior knowledge, making it challenging for true beginners."
"I found the pace a bit too quick, especially in certain sections; I had to rewatch videos multiple times."

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Scripting with Python and SQL for Data Engineering with these activities:
Join a study group or online forum for Python and data engineering discussions
Engage with peers and experts in the field by actively participating in discussions, sharing knowledge, and collaborating on projects.
Browse courses on Python
Show steps
  • Identify and join relevant study groups or online forums
  • Participate in discussions, ask questions, and share your insights
  • Collaborate on projects or group challenges
Review basic Python skills
Let's brush up on the fundamentals of Python programming to ensure you have the necessary foundational skills for this course.
Browse courses on Python
Show steps
  • Review variables and data types
  • Practice writing and executing simple Python scripts
  • Create a few basic functions and classes
Complete an online Python tutorial
Deepen your understanding of Python by following a guided tutorial that covers data structures and their applications.
Browse courses on Python
Show steps
  • Identify a reputable online tutorial or course
  • Follow the tutorial step-by-step, practicing the concepts
  • Complete any exercises or assignments provided in the tutorial
Five other activities
Expand to see all activities and additional details
Show all eight activities
Attend a Python workshop focused on data engineering
Advance your knowledge and skills in Python and data engineering by attending a specialized workshop led by industry experts.
Browse courses on Python
Show steps
  • Research and identify relevant workshops
  • Register and attend the workshop
  • Actively participate in discussions, demos, and hands-on exercises
Solve Python coding challenges
Challenge yourself with Python coding challenges to reinforce your grasp of data structures and algorithms.
Browse courses on Python
Show steps
  • Join an online coding platform like LeetCode or HackerRank
  • Select coding challenges appropriate to your skill level
  • Solve the challenges, referring to documentation or online forums when needed
Create a Python script to automate a data processing task
Solidify your Python skills by creating a project that leverages data manipulation and automation techniques.
Browse courses on Python
Show steps
  • Identify a data processing task that can be automated
  • Design a solution using Python and appropriate libraries
  • Write the Python script, incorporating functions and data structures as needed
  • Test and refine the script to ensure accurate and efficient data processing
Develop a dashboard to visualize data using Python
Combine your Python skills with data visualization techniques to create an interactive dashboard that effectively communicates data insights.
Browse courses on Python
Show steps
  • Gather and clean the necessary data
  • Choose an appropriate Python library for data visualization
  • Design and develop the dashboard layout and visualizations
  • Deploy the dashboard for sharing and presentation
Participate in a Python-based hackathon or competition
Engage in a competitive environment to showcase your Python skills and expand your knowledge in practical applications of data science or machine learning.
Browse courses on Python
Show steps
  • Identify and register for an appropriate hackathon or competition
  • Form a team or work individually on the challenge
  • Develop a solution using Python and relevant technologies
  • Present or submit your solution for evaluation

Career center

Learners who complete Scripting with Python and SQL for Data Engineering will develop knowledge and skills that may be useful to these careers:

Reading list

We've selected 50 books that we think will supplement your learning. Use these to develop background knowledge, enrich your coursework, and gain a deeper understanding of the topics covered in Scripting with Python and SQL for Data Engineering.
The official manual for MySQL, providing comprehensive documentation on all aspects of the database, including installation, configuration, operations, and troubleshooting. It is an essential reference for anyone working with MySQL.
This classic book by Edward Tufte must-read for anyone interested in data visualization. It covers a wide range of topics, from the principles of visual perception to the design of effective charts and graphs.
Seminal work on the grammar of graphics, a formal language for describing data visualizations. It covers a wide range of topics, from the basics of the grammar of graphics to the use of the grammar of graphics to create a variety of charts and graphs.
Created by the original architect of pandas, this masterwork teaches the canonical data structures and vectorized operations essential for slicing, cleaning, merging, and reshaping complex tabular datasets in Python.
Considered a modern classic, this book delves into the fundamental trade-offs and concepts behind building robust, scalable, and maintainable data systems. While not exclusively about data engineering, its in-depth coverage of distributed systems, databases, and data processing patterns is essential for any data professional looking to deepen their understanding. It is highly valuable for undergraduate and graduate students, as well as working professionals.
Presents the modern tidyverse grammar for transforming messy data into structured insights. Covers tibbles, dplyr pipelines, tidyr pivoting, and purrr iterations for rapid exploratory data manipulation.
Often referred to as "CLRS," this book comprehensive and widely-used textbook for undergraduate and graduate-level algorithms courses. It provides in-depth knowledge of data structures and algorithms, including their analysis and implementation. While it assumes some mathematical familiarity, it's an encyclopedic reference valuable for both learning and as a long-term resource.
Gathers hundreds of battle-tested recipes covering network programming, memory management, data structures, and functional decorators for veteran application developers.
Demystifies relational data transformation through practical PostgreSQL projects. Teaches window functions, subqueries, regular expressions, and cross-tabulations required to manipulate data directly inside the database.
Delivers a comprehensive, project-driven guide to wrangling messy timeseries, handling missing values, and restructuring dataframes with pandas. Emphasizes defensive coding and performance profiling for large analytical workloads.
Explores the mathematical and algorithmic techniques for transforming raw tabular data into predictive signals. Details numeric scaling, log transforms, categorical encoding, text vectorization, and automated feature extraction.
Introduces clean architecture, domain-driven design, and event-driven microservices to Python developers, demonstrating repository patterns and dependency inversion.
Essential for anyone looking to deepen their understanding of SQL performance and optimization. explains how databases execute queries and provides insights into writing efficient SQL code. It's highly recommended for developers and database administrators aiming to improve application performance.
Guides engineers through extracting, cleaning, and transforming irregular data from diverse formats including JSON, XML, PDF, and messy CSVs. Focuses on automation, error detection, and parsing web feeds reliably.
Demystifies programming for practical utility, guiding beginners through real-world automation projects including web scraping, spreadsheet generation, and file audits.
Provides a deep, foundational look into R core data objects, subscripting mechanics, factor conversions, string manipulation, and reshaping vectors. Offers timeless clarity on base R data processing paradigms.
Another comprehensive guide to Apache Spark, co-authored by one of its creators. definitive resource for learning Spark for big data processing, covering its various components and APIs. It's a must-read for anyone serious about using Spark in their data engineering work, suitable for undergraduate, graduate, and professional levels.
Provides a comprehensive introduction to web scraping using Python. It covers fundamental concepts and techniques, making it ideal for gaining a broad understanding of the topic. The book widely recognized resource and often recommended for beginners in web scraping. It's a valuable reference for anyone starting out or looking to solidify their foundational knowledge.
Provides a foundational understanding of the fundamental principles of data science and the data-analytic thinking necessary for extracting value from data in a business context. It is highly relevant for undergraduate business analytics programs and working professionals. It serves as a useful reference for understanding the business applications of data analysis and is commonly used as a textbook.
Focuses on static typing, structural subtyping, and defensive design techniques, demonstrating how modern type annotations prevent regressions in enterprise codebases.
Lays out a systematic workflow for profiling, assessing, and structuring untidy business data. Connects data preparation directly to downstream analytics, preventing upstream bias and data transformation bottlenecks.
Offers a comprehensive treatment of data structures and algorithms, suitable for academic settings. It covers various data types and algorithms for sorting, searching, and processing. The book is known for its detailed explanations and includes an online portal with source code, making it a strong resource for solidifying understanding.
A comprehensive and in-depth guide to MySQL, covering advanced topics such as database design, performance tuning, and replication. It is written by a MySQL expert and provides valuable insights for experienced users looking to master the database.
Provides a comprehensive overview of data visualization, covering the basics of visual perception, data types, and chart types. It great resource for beginners who want to learn the fundamentals of data visualization.
Apache Spark widely used engine for big data processing. provides a comprehensive introduction to Spark, covering its core concepts and APIs. It's essential for anyone working with big data pipelines and aligns with courses mentioning Spark. The 3rd edition, published in 2020, covers recent features and improvements.
Delivers fast, battle-tested techniques for cleaning and pivoting irregular spreadsheet exports. Shows how to master Power Query, dynamic arrays, and nested lookups to clean corporate datasets with surgical speed.
Presents a proactive architectural framework for monitoring data pipelines and catching silent transformation bugs. Teaches automated anomaly detection, schema drift prevention, and lineage tracking for robust data operations.
Dives into common mistakes and suboptimal solutions in database design and SQL coding, explaining how to identify and correct them. It's crucial for deepening understanding and writing more robust and maintainable SQL. It's a valuable resource for developers and database professionals seeking to improve their practices.
Unpacks professional testing methodologies using pytest, explaining fixture management, parameterized tests, coverage tracking, and automated CI test execution.
Geared towards a data science audience, this book offers a modern guide to web scraping with Python, emphasizing best practices. It covers the larger context of web technologies and how scraping fits into the data science workflow. is excellent for those with some programming background who want to apply web scraping to data analysis tasks.
Exposes the most widespread and damaging traps in relational data manipulation and query construction. Illustrates how to avoid Cartesian explosion, improper NULL comparisons, and flawed table structures with cleaner SQL alternatives.
Collects cautionary case studies from seasoned data practitioners detailing how hidden encoding bugs, missing fields, schema mismatches, and parsing failures occur, with concrete recipes for defensive data hygiene.
Focuses on using SQL specifically for data analysis, covering techniques beyond basic querying to transform and gain insights from data. It's suitable for those who have a foundational understanding of SQL and want to apply it in a data analysis context. It's relevant for data scientists and analysts.
While focused on MySQL, this book provides in-depth coverage of database and SQL performance tuning that is applicable to other systems. It's essential for those working with large datasets and high-traffic applications. It's a comprehensive guide for optimizing SQL queries and database infrastructure.
This textbook is suitable for advanced data structures or introductory graduate-level algorithm analysis courses. It bridges the gap between foundational data structures and more advanced analysis techniques. The book provides a rigorous and in-depth analysis of algorithms and their implementation in C++.
Investigates advanced software craft, detailing packaging distribution, bytecode internals, scaling architectures, and maintainability across large distributed systems.
Strong choice for beginners looking to understand how to use SQLite effectively. It guides readers through data modeling, SQLite's SQL dialect, and integrating SQLite into applications. It is considered a good introductory book for developers and database administrators and a better choice for SQLite-only readers compared to general SQL books.
Focuses on the crucial skill of communicating insights from data effectively through compelling visualizations. is highly relevant for all levels, emphasizing the importance of clear and impactful data presentation. It is valuable additional reading that complements technical data analysis skills.
Aligning with the Google Cloud focused course titles, this book provides guidance on performing data engineering tasks on GCP. It's a valuable resource for those preparing for the Google Cloud Professional Data Engineer exam or working with GCP data services. It covers the relevant tools and services offered by Google Cloud.
Bridges the gap between statistical theory and its practical application in data science using R and Python. It focuses on the statistical concepts most relevant to data scientists and provides code examples. It's a useful reference and learning resource for those applying statistics in their work.
Bridges volumetric point cloud analysis with Python, teaching LiDAR processing, spatial meshing, and 3D machine vision using modern scientific computing toolchains.
While focused on T-SQL (for Microsoft SQL Server), this book provides a deep and rigorous understanding of SQL fundamentals that are applicable to many dialects. It's highly regarded for its clear explanations and challenging examples, making it excellent for solidifying core concepts. It's often used by professionals working with SQL Server.
Tailored for aspiring data scientists, this book focuses on the SQL skills needed for data analysis, including dataset construction and manipulation. It bridges the gap between basic SQL and its application in data science workflows. Relevant for those entering or working in the data science field.
An updated version of the hands-on guide, incorporating the latest libraries and techniques in Python web scraping. This edition provides current practical examples and covers advanced topics. It's a valuable resource for both beginners and those looking to update their skills with contemporary methods.
Introduces high-performance dataframe processing using Polars and Apache Arrow memory layout. Demonstrates lazy evaluation, query optimization, and multicore parallel execution for multiterabyte data manipulation in Python.

Share

Help others find this course page by sharing it with your friends and followers:

Similar courses

Here are nine courses similar to Scripting with Python and SQL for Data Engineering.
Scripting with Python and SQL for Data Engineering
Most relevant
Database Engineer Capstone
Most relevant
Relational Databases for Beginners
Most relevant
SQL-MySQL: 2021 Complete Master Bootcamp | Beginner-Expert
Most relevant
The Complete Python/PostgreSQL Course 2.0
Most relevant
Working with Data
Most relevant
Learn Python Programming - Beginner to Master
Most relevant
10 Day MySQL Bootcamp | My SQL Database Design for...
Most relevant
Top Database Bundle: MySQL, PostgreSQL, SQLite3, SQL...
Most relevant

edX Buyer Protection & Guarantee

Verified partner policies & purchase protections

World-Class University Partner
Free Trial & Audit

Free Audit Track Available

Free audit track available for most courses, giving open access to video lectures, course readings, and assignments at no charge.

Return & Refund Policy

14-Day Full Refund Window

14-day full refund available up to 14 days after course start or 14 days after payment (whichever comes second, up to 6 months max), provided verified certificate has not yet been earned.

Buyer Protections

Verified Academic & Industry Partner

University-backed credentials authored by elite institutions like Harvard, MIT, and Oxford, with tamper-proof certificate verification.

Key Purchase Protections
Free audit track for open learning access
14-day money-back guarantee on verified certificates
Prestigious university credentials (Harvard, MIT)
Automatic unenrollment refund process via dashboard
OpenCourser Verified Partner Policy details last reviewed: 2026-10-22
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2025 OpenCourser