We may earn an affiliate commission when you visit our partners.
Alfredo Deza,
Kennedy Behrman,
and
Noah Gift
In this third course of the Python, Bash and SQL Essentials for Data Engineering Specialization, you will explore techniques to work effectively with Python and SQL. We will go through useful data structures in Python scripting and connect to databases like MySQL. Additionally, you will learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. Finally, you will use extracted data from websites using scraping techniques. These skills will allow you to work effectively when data is not readily available, or when spatial queries are required to extract useful information from databases.
Register for this course and see more details by visiting:
OpenCourser.com/course/ll17jb/scripting
What's inside
Syllabus
Working with Data in Python
This week, you will learn how to effectively use Python’s data structures to load, persist, and iterate over data. You will apply these data structures to solve different problems when working with popular data formats like JSON.
Read more
Syllabus
Working with Data in Python
This week, you will learn how to effectively use Python’s data structures to load, persist, and iterate over data. You will apply these data structures to solve different problems when working with popular data formats like JSON.
Read more
Python Scripting and SQL
This week, you will learn how to use Python scripting techniques to work with SQL. You will create a database, store data, and query that data with SQL from Python.
Web Scraping using Python
This week, you will learn how to efficiently extract data from the web. You will learn how to use a scraping library to read data from websites and identify and extract specific values from it.
Working with MySQL
This week, you will learn how to use a modern development environment and editor to connect to a MySQL database server, execute queries and perform database operations.
Good to know
Good to know
Know what's good ,
what to watch for , and
possible dealbreakers
Emphasizes data manipulation techniques
Provides hands-on practice through interactive materials
In-demand skills for data engineering roles
Suitable for beginners seeking a foundation in data engineering essentials
Taught by experienced instructors in the field
Covers industry-standard Python data structures and SQL capabilities
Save this course
Save Scripting with Python and SQL for Data Engineering to your list so you can find it easily later:
Save
Save
Activities
Be better prepared
before
your course. Deepen your understanding
during
and
after
it. Supplement your coursework and achieve mastery of the topics covered
in Scripting with Python and SQL for Data Engineering with these
activities:
Organize and review course materials
Show steps
Organize and review notes, assignments, quizzes, and exams to solidify your understanding of the course material.
Show steps
-
Create a dedicated folder or notebook for course materials.
-
Organize materials into logical sections or categories.
-
Review materials regularly to refresh your memory and reinforce concepts.
-
Identify areas where you need further clarification or support.
Review and practice Python data structures
Show steps
Practice working with Python's data structures to improve your understanding of data handling and manipulation.
Browse courses on
Python
Show steps
-
Review different data structures available in Python.
-
Write code to create, access, and modify data in these structures.
-
Apply data structures to solve common programming problems.
-
Compare the efficiency and suitability of different data structures for specific tasks.
Follow tutorials on Python scripting and SQL
Show steps
Explore tutorials to enhance your understanding of Python scripting and SQL, which are essential skills for data engineering.
Browse courses on
Python Scripting
Show steps
-
Find tutorials on Python scripting and SQL.
-
Follow the tutorials step-by-step.
-
Complete the exercises and assignments provided in the tutorials.
-
Refer to the tutorials for quick refreshers or clarifications.
Four other activities
Expand to see all activities and additional details
Show all seven activities
Practice SQL queries
Show steps
Practice writing and executing SQL queries to improve your understanding of data manipulation and retrieval.
Browse courses on
SQL
Show steps
-
Set up a MySQL database and import sample data.
-
Write SQL queries to retrieve specific data from the database.
-
Use aggregate functions to summarize and group data.
-
Practice joining tables to combine data from multiple sources.
Build a web scraping tool
Show steps
Create a web scraping tool to extract data from websites, which can be used for data analysis or research.
Browse courses on
Web Scraping
Show steps
-
Identify the target website and the data you want to extract.
-
Choose a web scraping library and set it up.
-
Write code to navigate the website and extract the desired data.
-
Handle errors and exceptions that may occur during scraping.
-
Store the extracted data in a structured format.
Create a presentation or video on data engineering concepts
Show steps
Develop a presentation or video to explain a specific data engineering concept, which can help you deepen your understanding and share your knowledge.
Show steps
-
Choose a specific data engineering concept to focus on.
-
Gather information and resources on the selected topic.
-
Create a storyboard or outline for your presentation or video.
-
Develop the content, including visuals and examples.
-
Present or record your work and share it with others.
Design a database schema for a real-world application
Show steps
Create a database schema for a real-world application, which provides hands-on experience in designing and structuring databases.
Browse courses on
Database Design
Show steps
-
Analyze the requirements and data entities for the application.
-
Develop a conceptual model of the data relationships.
-
Translate the conceptual model into a logical database schema.
-
Create and implement the database schema using MySQL.
-
Document and explain the design decisions and optimizations.
Organize and review course materials
Show steps
Organize and review notes, assignments, quizzes, and exams to solidify your understanding of the course material.
Show steps
Show steps
Show steps
- Create a dedicated folder or notebook for course materials.
- Organize materials into logical sections or categories.
- Review materials regularly to refresh your memory and reinforce concepts.
- Identify areas where you need further clarification or support.
Review and practice Python data structures
Show steps
Practice working with Python's data structures to improve your understanding of data handling and manipulation.
Browse courses on
Python
Show steps
Show steps
Show steps
- Review different data structures available in Python.
- Write code to create, access, and modify data in these structures.
- Apply data structures to solve common programming problems.
- Compare the efficiency and suitability of different data structures for specific tasks.
Follow tutorials on Python scripting and SQL
Show steps
Explore tutorials to enhance your understanding of Python scripting and SQL, which are essential skills for data engineering.
Browse courses on
Python Scripting
Show steps
Show steps
Show steps
- Find tutorials on Python scripting and SQL.
- Follow the tutorials step-by-step.
- Complete the exercises and assignments provided in the tutorials.
- Refer to the tutorials for quick refreshers or clarifications.
Four other activities
Expand to see all activities and additional details
Show all seven activities
Practice SQL queries
Show steps
Practice writing and executing SQL queries to improve your understanding of data manipulation and retrieval.
Browse courses on
SQL
Show steps
Show steps
Show steps
- Set up a MySQL database and import sample data.
- Write SQL queries to retrieve specific data from the database.
- Use aggregate functions to summarize and group data.
- Practice joining tables to combine data from multiple sources.
Build a web scraping tool
Show steps
Create a web scraping tool to extract data from websites, which can be used for data analysis or research.
Browse courses on
Web Scraping
Show steps
Show steps
Show steps
- Identify the target website and the data you want to extract.
- Choose a web scraping library and set it up.
- Write code to navigate the website and extract the desired data.
- Handle errors and exceptions that may occur during scraping.
- Store the extracted data in a structured format.
Create a presentation or video on data engineering concepts
Show steps
Develop a presentation or video to explain a specific data engineering concept, which can help you deepen your understanding and share your knowledge.
Show steps
Show steps
Show steps
- Choose a specific data engineering concept to focus on.
- Gather information and resources on the selected topic.
- Create a storyboard or outline for your presentation or video.
- Develop the content, including visuals and examples.
- Present or record your work and share it with others.
Design a database schema for a real-world application
Show steps
Create a database schema for a real-world application, which provides hands-on experience in designing and structuring databases.
Browse courses on
Database Design
Show steps
Show steps
Show steps
- Analyze the requirements and data entities for the application.
- Develop a conceptual model of the data relationships.
- Translate the conceptual model into a logical database schema.
- Create and implement the database schema using MySQL.
- Document and explain the design decisions and optimizations.
Career center
Learners who complete Scripting with Python and SQL for Data Engineering will develop knowledge and skills
that may be useful to these careers:
Data Engineer
Data Engineer
The course will teach you how to work effectively with Python and SQL, two essential tools for data engineers. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for data engineers, who are responsible for designing, building, and maintaining data pipelines.
Data Analyst
Data Analyst
The skills you gain in Scripting with Python and SQL for Data Engineering can help prepare you for a career as a Data Analyst, a role that involves collecting, cleaning, and analyzing data to help businesses make informed decisions. The course covers techniques for working effectively with Python and SQL, two essential tools for data analysts. The section on web scraping can also be useful for data analysts who need to extract data from websites.
Database Administrator
Database Administrator
The course covers techniques for working effectively with Python and SQL, two essential tools for database administrators. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are essential for database administrators, who are responsible for managing and maintaining databases.
Machine Learning Engineer
Machine Learning Engineer
The course covers techniques for working effectively with Python and SQL, two essential tools for machine learning engineers. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for machine learning engineers, who are responsible for designing, building, and maintaining machine learning models.
Data Scientist
Data Scientist
The course covers techniques for working effectively with Python and SQL, two essential tools for data scientists. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for data scientists, who are responsible for collecting, cleaning, and analyzing data to help businesses make informed decisions.
Financial Analyst
Financial Analyst
The course covers techniques for working effectively with Python and SQL, two essential tools for financial analysts. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for financial analysts, who are responsible for analyzing data to help businesses make informed decisions.
Market Researcher
Market Researcher
The course covers techniques for working effectively with Python and SQL, two essential tools for market researchers. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for market researchers, who are responsible for collecting, cleaning, and analyzing data to help businesses make informed decisions.
Business Analyst
Business Analyst
The course covers techniques for working effectively with Python and SQL, two essential tools for business analysts. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for business analysts, who are responsible for analyzing data to help businesses make informed decisions.
Operations Research Analyst
Operations Research Analyst
The course covers techniques for working effectively with Python and SQL, two essential tools for operations research analysts. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for operations research analysts, who are responsible for analyzing data to help businesses make informed decisions.
Statistician
Statistician
The course covers techniques for working effectively with Python and SQL, two essential tools for statisticians. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for statisticians, who are responsible for collecting, cleaning, and analyzing data to help businesses make informed decisions.
Web Developer
Web Developer
The course covers techniques for working effectively with Python and SQL, two essential tools for web developers. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for web developers, who are responsible for designing, building, and maintaining websites.
Actuary
Actuary
The course covers techniques for working effectively with Python and SQL, two essential tools for actuaries. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for actuaries, who are responsible for analyzing data to help insurance companies make informed decisions.
Software Developer
Software Developer
The course covers techniques for working effectively with Python and SQL, two essential tools for software developers. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for software developers, who are responsible for designing, building, and maintaining software applications.
Consultant
Consultant
The course covers techniques for working effectively with Python and SQL, two essential tools for consultants. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for consultants, who are responsible for providing advice to businesses on a variety of topics.
Project Manager
Project Manager
The course covers techniques for working effectively with Python and SQL, two essential tools for project managers. You will also learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. These skills are in high demand for project managers, who are responsible for planning, organizing, and managing projects.
For more career information including salaries, visit:
OpenCourser.com/course/ll17jb/scripting
Reading list
We've selected 12 books
that we think will supplement your
learning. Use these to
develop background knowledge, enrich your coursework, and gain a
deeper understanding of the topics covered in
Scripting with Python and SQL for Data Engineering.
Offers a comprehensive overview of Python programming, covering essential concepts such as data structures, algorithms, and object-oriented programming. It's a valuable resource for both beginners and experienced Python developers who want to deepen their understanding of the language.
Offers a hands-on approach to data science, covering fundamental concepts such as data manipulation, statistical modeling, and machine learning. It emphasizes the use of Python throughout the book, making it a practical resource for those interested in data science.
Provides a comprehensive guide to data science using Python, covering topics such as data manipulation, statistical modeling, and machine learning. It's a valuable reference for those who want to learn the practical aspects of data science using Python.
Offers a comprehensive guide to deep learning using Python, covering essential topics such as neural networks, convolutional neural networks, and recurrent neural networks. It's a valuable resource for those who want to learn the fundamentals of deep learning and apply them using Python.
Provides a comprehensive introduction to natural language processing (NLP) using Python, covering essential topics such as text preprocessing, tokenization, and text classification. It's a valuable resource for those who want to learn the fundamentals of NLP and apply them using Python.
Focuses specifically on Python's data analysis capabilities, covering essential topics such as data exploration, data cleaning, and data visualization. It's a valuable resource for those who want to delve deeper into Python's data analysis capabilities.
Offers a comprehensive overview of the Python Standard Library, providing detailed explanations of its modules and functions. It's a valuable reference for developers who want to make the most of Python's built-in capabilities.
Focuses on the Pandas library for data manipulation and analysis in Python. It covers essential topics such as data structures, data cleaning, and data merging, making it a valuable resource for those who want to learn how to work with data effectively in Python.
Provides a practical introduction to machine learning using Python, covering essential topics such as supervised learning, unsupervised learning, and model evaluation. It's a valuable resource for those who want to learn the fundamentals of machine learning and apply them using Python.
Provides an accessible introduction to SQL, focusing on the practical application of SQL in data management and analysis. It's written in a conversational and engaging style, making it a good choice for beginners or those looking to refresh their SQL knowledge.
Offers a hands-on guide to web scraping using Python, covering techniques for extracting data from websites, parsing HTML, and handling common challenges in web scraping. It's a practical resource for those who want to learn how to extract data from the web.
Provides a practical introduction to Python programming with a focus on automation tasks. It covers essential concepts such as data structures, control flow, and file handling, making it a good choice for beginners who want to learn the basics of Python.
For more information about how these books relate to this course, visit:
OpenCourser.com/course/ll17jb/scripting
Share
Similar courses
Here are nine courses similar to
Scripting with Python and SQL for Data Engineering.
Scripting with Python and SQL for Data Engineering
OpenCourser.com/course/iw9sje/scripting
Scripting with Python and SQL for Data Engineering
Most relevant
SQL for Data Science
OpenCourser.com/course/eoz1cw/sql
SQL for Data Science
Most relevant
Building Your Own Database Agent
OpenCourser.com/course/qbgp41/building
Building Your Own Database Agent
Most relevant
SQL for Beginners: Querying Data
OpenCourser.com/course/1230au/sql
SQL for Beginners: Querying Data
Most relevant
Using SQL for Data Analysis
OpenCourser.com/course/yoya18/using
Using SQL for Data Analysis
Most relevant
Understanding Databases with SQLAlchemy 1: Python Data Playbook
OpenCourser.com/course/5oiauw/understanding
Understanding Databases with SQLAlchemy 1: Python Data...
Most relevant
Introduction to SQL
OpenCourser.com/course/2rgq9d/introduction
Introduction to SQL
Most relevant
Real-world Scenarios: SQL Server Query Tuning in Action
OpenCourser.com/course/1w9vm7/real
Real-world Scenarios: SQL Server Query Tuning in Action
Most relevant
Data Literacy : Essentials of Azure Data Studio
OpenCourser.com/course/i0zsmr/data
Data Literacy : Essentials of Azure Data Studio
Most relevant
Effort
4 weeks of study, 5-7 hours/week
Level
Intermediate
Via
Coursera
Institution
Duke University
Instructors
Alfredo Deza
Kennedy Behrman
Noah Gift
Language
English
Transcripts
Español
Français
Português
Deutsch
Italiano
中文
العربية
한국어
日本語
हिंदी
Nederlands
Svenska
Pусский
Türkçe
Polski
Ελληνικά
українська мова
Bahasa Indonesia
ไทย
қазақша
This course belongs to a
collection
called
Python, Bash and SQL Essentials for Data Engineering. It's comprised of four courses:
- Linux and Bash for Data Engineering
- Web Applications and Command-Line Tools for Data Engineering
- Scripting with Python and SQL for Data Engineering (viewing)
- Python and Pandas for Data Engineering
Good to know
Emphasizes data manipulation techniques
Provides hands-on practice through interactive materials
In-demand skills for data engineering roles
Suitable for beginners seeking a foundation in data engineering essentials
Taught by experienced instructors in the field
Covers industry-standard Python data structures and SQL capabilities
Our mission
OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.
Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.
Find this site helpful? Tell a friend about us.
Affiliate disclosure
We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.
Your purchases help us maintain our catalog and keep our servers humming without ads.
Thank you for supporting OpenCourser.
© 2016 - 2024 OpenCourser