We may earn an affiliate commission when you visit our partners.
Paul Resnick
This course teaches you to fetch and process data from services on the Internet. It covers Python list comprehensions and provides opportunities to practice extracting from and processing deeply nested data. You'll also learn how to use the Python requests module to interact with REST APIs and what to look for in documentation of those APIs. For the final project, you will construct a “tag recommender” for the flickr photo sharing site.
Read more
This course teaches you to fetch and process data from services on the Internet. It covers Python list comprehensions and provides opportunities to practice extracting from and processing deeply nested data. You'll also learn how to use the Python requests module to interact with REST APIs and what to look for in documentation of those APIs. For the final project, you will construct a “tag recommender” for the flickr photo sharing site.
Read more
This course teaches you to fetch and process data from services on the Internet. It covers Python list comprehensions and provides opportunities to practice extracting from and processing deeply nested data. You'll also learn how to use the Python requests module to interact with REST APIs and what to look for in documentation of those APIs. For the final project, you will construct a “tag recommender” for the flickr photo sharing site.
The course is well-suited for you if you have already taken the "Python Basics" and "Python Functions, Files, and Dictionaries" courses (courses 1 and 2 of the Python 3 Programming Specialization). If you are already familiar with Python fundamentals but want practice at retrieving and processing complex nested data from Internet services, you can also benefit from this course without taking the previous two.
This is the third of five courses in the Python 3 Programming Specialization.
Register for this course and see more details by visiting:
OpenCourser.com/course/mond3r/data
What's inside
Syllabus
Nested Data and Nested Iteration
In week one the video lectures and activities from the Runestone textbook will cover more complex data structures. By the end of this week, you will have learned how to process json formatted data, traverse nested data using nested iteration, and extract values from nested data.
Read more
Syllabus
Nested Data and Nested Iteration
In week one the video lectures and activities from the Runestone textbook will cover more complex data structures. By the end of this week, you will have learned how to process json formatted data, traverse nested data using nested iteration, and extract values from nested data.
Read more
Map, Filter, and List Comprehensions
In week two you will be learning more advanced forms of accumulation. By the end of the week, you will have learned how to use the map and filter functions in combination with functions to transform or filter out data and store the resulting data in a new object. You will have also learned how to accumulate data using a list comprehension.
Internet APIs
In week three you will learn how to request data from the internet using Application Programming Interfaces (APIs). By the end of the week, you will have learned how to access data from a few APIs, cache data that you have requested, and also learned how to read and work with other APIs that were not touched on in the module.
Good to know
Good to know
Know what's good ,
what to watch for , and
possible dealbreakers
Develops core Python skills for data fetching and processing from services on the Internet
Builds on prior courses in the 'Python 3 Programming Specialization' series
Introduces the Python requests module for interacting with REST APIs and API documentation
Emphasizes list comprehensions and provides opportunities to practice extracting and processing deeply nested data
Culminates in a practical project of building a tag recommender for Flickr
Save this course
Save Data Collection and Processing with Python to your list so you can find it easily later:
Save
Save
Reviews summary
Python data processing and collection
learners say this Python course is practical, hands-on, and has a lot of quality content.High-quality assignments, engaging lectures, and a friendly professor are highlights of this course.Importantly, students are not expected to have any experience with Python to take this course. However, some learners have experienced difficulty and frustration with the final project and the Runestone environment.
Difficult but rewarding culminating project that brings together skills from previous courses.
"The Final Project, should not be based on a module that is not standard in Python."
"Finishing the course and getting the certificate, will give you great satisfaction."
"The videos, examples and practice material were once again excellent"
Well-paced and informative video lectures, though some may find them a bit basic.
"The videos and corresponding textbook is awesome as ever, but I have a small suggestion."
"The videos are high quality and informative, the Rhinestone online textbook is a great source for practical experience in writing code and the daily practice keeps up your recollection of earlier topics."
"I really learned more than I expected to, a good intro to map/reduce, list comprehension, filtering, and a fairly meaty end of course project."
Interactive textbook and assignments allow for practical application of skills.
"The course provides a deep understanding of nested dictionary and list in python, Week 3 was especially helpful where the actual use of these data structures is explained when using REST API to extract data in JSON format."
"This was a very efficient course."
"I had an easier time with this project than with the project from Course 2 (Python Functions, Files, and Dictionaries)."
Challenging but achievable assignments build on previous knowledge and provide good practice.
"This is overall an excellent course, although the last assignment was significantly more difficult than the assignments in the previous courses."
"The first two courses are great and I learned a lot."
"Very good material on how to iterate through nested data structures and retrieving and organizing data from web url's."
In-browser programming environment allows for immediate testing but can be buggy.
"Runestone never seems to work and I can't practice the lessons."
"The final project was quite hard and time consuming ... but it was fun to handle difficult problem....Love this course....."
"I understand that APIs are an integral part of getting into programming but, I feel that this course was just streamlined to make use of APIs."
Activities
Be better prepared
before
your course. Deepen your understanding
during
and
after
it. Supplement your coursework and achieve mastery of the topics covered
in Data Collection and Processing with Python with these
activities:
Compile a list of useful resources for data extraction
Show steps
Create a valuable reference for yourself and others by organizing and expanding on the course materials on data extraction.
Browse courses on
Python
Show steps
-
Review the course materials and identify key resources
-
Search for additional resources on the Internet, such as tutorials, articles, and tools
-
Organize the resources into a structured format, such as a document or website
Read 'Web Scraping with Python' by Ryan Mitchell
Show steps
Gain a comprehensive understanding of web scraping techniques and best practices.
View
Web Scraping with Python: Data Extraction from...
on Amazon
Show steps
-
Read through the book's chapters on data extraction and web scraping
-
Apply the concepts to your own web scraping projects
Practice using Python list comprehensions
Show steps
Refresh your understanding of Python list comprehensions to prepare for extracting and processing data from Internet services.
Browse courses on
Python
Show steps
-
Review the syntax and usage of Python list comprehensions
-
Complete practice exercises involving extracting data using list comprehensions
Five other activities
Expand to see all activities and additional details
Show all eight activities
Follow online tutorials on using BeautifulSoup for web scraping
Show steps
Expand your data extraction skills by learning to use BeautifulSoup for web scraping.
Browse courses on
BeautifulSoup
Show steps
-
Find reputable online tutorials on BeautifulSoup
-
Follow the tutorials and practice using BeautifulSoup
-
Apply your newfound knowledge to extract data from websites
Complete Python coding challenges related to data extraction
Show steps
Solidify your understanding of Python data extraction techniques through practice.
Browse courses on
Data Extraction
Show steps
-
Find coding challenges that focus on data extraction
-
Attempt to solve the challenges using Python
-
Review solutions and learn from your mistakes
Contribute to open-source projects related to data extraction
Show steps
Gain practical experience and contribute to the community by volunteering on data extraction projects.
Browse courses on
Open-Source
Show steps
-
Find open-source projects that focus on data extraction
-
Identify areas where you can make contributions
-
Collaborate with the project team and submit pull requests
Build a Python script to extract data from a specific API
Show steps
Apply your knowledge of Python and APIs to create a practical tool for extracting data from the Internet.
Browse courses on
Data Extraction
Show steps
-
Identify an API that provides data relevant to your interests
-
Use Python's requests module to interact with the API
-
Extract the desired data and store it in a structured format
-
Test your script to ensure it retrieves data accurately
Participate in a hackathon focused on data extraction and analysis
Show steps
Challenge yourself and collaborate with others to apply your data extraction skills in a practical setting.
Show steps
-
Find a hackathon that aligns with your interests
-
Form a team or join an existing one
-
Develop a project proposal and build a solution involving data extraction
-
Present your project to a panel of judges
Compile a list of useful resources for data extraction
Show steps
Create a valuable reference for yourself and others by organizing and expanding on the course materials on data extraction.
Browse courses on
Python
Show steps
Show steps
Show steps
- Review the course materials and identify key resources
- Search for additional resources on the Internet, such as tutorials, articles, and tools
- Organize the resources into a structured format, such as a document or website
Read 'Web Scraping with Python' by Ryan Mitchell
Show steps
Gain a comprehensive understanding of web scraping techniques and best practices.
View
Web Scraping with Python: Data Extraction from...
on Amazon
Show steps
Show steps
Show steps
- Read through the book's chapters on data extraction and web scraping
- Apply the concepts to your own web scraping projects
Practice using Python list comprehensions
Show steps
Refresh your understanding of Python list comprehensions to prepare for extracting and processing data from Internet services.
Browse courses on
Python
Show steps
Show steps
Show steps
- Review the syntax and usage of Python list comprehensions
- Complete practice exercises involving extracting data using list comprehensions
Five other activities
Expand to see all activities and additional details
Show all eight activities
Follow online tutorials on using BeautifulSoup for web scraping
Show steps
Expand your data extraction skills by learning to use BeautifulSoup for web scraping.
Browse courses on
BeautifulSoup
Show steps
Show steps
Show steps
- Find reputable online tutorials on BeautifulSoup
- Follow the tutorials and practice using BeautifulSoup
- Apply your newfound knowledge to extract data from websites
Complete Python coding challenges related to data extraction
Show steps
Solidify your understanding of Python data extraction techniques through practice.
Browse courses on
Data Extraction
Show steps
Show steps
Show steps
- Find coding challenges that focus on data extraction
- Attempt to solve the challenges using Python
- Review solutions and learn from your mistakes
Contribute to open-source projects related to data extraction
Show steps
Gain practical experience and contribute to the community by volunteering on data extraction projects.
Browse courses on
Open-Source
Show steps
Show steps
Show steps
- Find open-source projects that focus on data extraction
- Identify areas where you can make contributions
- Collaborate with the project team and submit pull requests
Build a Python script to extract data from a specific API
Show steps
Apply your knowledge of Python and APIs to create a practical tool for extracting data from the Internet.
Browse courses on
Data Extraction
Show steps
Show steps
Show steps
- Identify an API that provides data relevant to your interests
- Use Python's requests module to interact with the API
- Extract the desired data and store it in a structured format
- Test your script to ensure it retrieves data accurately
Participate in a hackathon focused on data extraction and analysis
Show steps
Challenge yourself and collaborate with others to apply your data extraction skills in a practical setting.
Show steps
Show steps
Show steps
- Find a hackathon that aligns with your interests
- Form a team or join an existing one
- Develop a project proposal and build a solution involving data extraction
- Present your project to a panel of judges
Career center
Learners who complete Data Collection and Processing with Python will develop knowledge and skills
that may be useful to these careers:
Data Scientist
Data Scientist
Data Scientists leverage their extensive mathematical, coding, and statistical skills alongside knowledge of computer science, business, and industry-specific knowledge to find insights in data. This course's focus on data collection and processing with Python can be a useful addition to the skillset of a Data Scientist, who will likely be involved in all stages of the data pipeline including data collection, storage, and processing.
Machine Learning Engineer
Machine Learning Engineer
Closely related to Data Scientists, Machine Learning Engineers focus on developing and refining algorithms to advance machine learning models. Being well-versed in data collection, data processing, and working with nested data is essential for Machine Learning Engineers. Because this course covers these topics, it may be useful for working professionals looking to transition to the field of Machine Learning.
Data Analyst
Data Analyst
Data Analysts work with data to collect, transform, and analyze it. The insights derived from this work are then used to make informed business decisions. Knowledge of data collection and processing are key for Data Analysts, and they may find the contents of this course helpful to expand their skills and knowledge in these areas.
Web Developer
Web Developer
Web Developers work with markup and programming languages to develop website functionality. This often includes integrating with external APIs to create features in the website. This course may be useful for Web Developers who wish to gain additional skills in data collection and processing from APIs.
Software Engineer
Software Engineer
Software Engineers build and design software applications. The knowledge and skills developed in this course, namely data collection and processing with Python, will be helpful for Software Engineers who may need to work with data from APIs in their projects.
Data Engineer
Data Engineer
Data Engineers are responsible for the design, construction, and maintenance of data pipelines. This often includes work with data collection and processing. This course, therefore, may expand the skills of a Data Engineer and be useful in demonstrating competency.
Business Analyst
Business Analyst
Business Analysts help companies understand how to improve their performance by leveraging data to identify opportunities. Much of the work that Business Analysts do requires data collection and processing skills. This course can be helpful for Business Analysts who wish to build upon these skills and apply them.
Statistician
Statistician
Statisticians collect, analyze, interpret, and present data. This work can require a strong understanding of data collection and processing, which this course covers in depth.
Research Analyst
Research Analyst
Research Analysts conduct research to provide insights and make recommendations to clients. Data collection and processing skills are essential for Research Analysts, and this course can help to develop and refine these skills.
Database Administrator
Database Administrator
Database Administrators ensure the smooth operation of databases. This often involves data collection and processing, skills that are covered in this course. Working professionals in this field may find this course useful for expanding their knowledge and skills in these areas.
UX Designer
UX Designer
UX Designers focus on improving the user experience of products and services. Data collection and processing skills can be useful for UX Designers who want to gain insights into user behavior. This course may be helpful for UX Designers who want to develop their skills in these areas.
Information Security Analyst
Information Security Analyst
Information Security Analysts plan and implement security measures to protect an organization's computer networks and systems. Data collection and processing skills may be useful for Information Security Analysts who need to collect and process data to identify and mitigate security risks.
Product Manager
Product Manager
Product Managers are responsible for the development and management of products. Data collection and processing skills can be useful for Product Managers who want to understand user behavior and make informed decisions about product development. This course may be helpful for Product Managers who want to build upon these skills.
Financial Analyst
Financial Analyst
Financial Analysts make investment recommendations to individuals and organizations. They typically collect and process data to make these recommendations. This course can help to develop the data collection and processing skills that Financial Analysts need to succeed in this field.
Market Research Analyst
Market Research Analyst
Market Research Analysts gather and interpret data to understand consumer behavior. Data collection and processing skills are essential for Market Research Analysts. This course may be helpful for working professionals in this field to expand their knowledge and skills in these areas.
For more career information including salaries, visit:
OpenCourser.com/course/mond3r/data
Reading list
We've selected nine books
that we think will supplement your
learning. Use these to
develop background knowledge, enrich your coursework, and gain a
deeper understanding of the topics covered in
Data Collection and Processing with Python.
Save
This comprehensive guide to Python 3 provides in-depth coverage of the language's features and capabilities. It valuable resource for intermediate and advanced Python programmers.
Provides a concise and practical guide to the core principles of JavaScript. It must-read for anyone who wants to write clear and maintainable JavaScript code.
Comprehensive and up-to-date guide to Python, providing valuable background and reference material for this course. It covers essential Python concepts, libraries, and tools and is commonly used as a textbook at academic institutions.
Save
This cookbook provides a collection of recipes for solving common Python programming problems. It serves as a valuable resource for finding quick solutions to specific challenges.
Provides a practical and hands-on introduction to Python programming. It great resource for beginners who want to learn the basics of Python quickly.
Save
Provides a comprehensive overview of web APIs and how to use them with JavaScript. It valuable resource for front-end developers who want to learn more about web APIs.
Save
Covers best practices and idioms for writing efficient and maintainable Python code. It provides valuable insights and tips for Python programmers of all levels.
Provides a practical guide to creating responsive web designs that work well on all devices. It valuable resource for anyone who wants to design websites that are accessible to a wide range of users.
This pocket reference provides a quick and easy way to look up jQuery syntax and functions. It useful tool for front-end developers who want to use jQuery in their web applications.
For more information about how these books relate to this course, visit:
OpenCourser.com/course/mond3r/data
Share
Similar courses
Here are nine courses similar to
Data Collection and Processing with Python.
Python Classes and Inheritance
OpenCourser.com/course/jjzqcn/python
Python Classes and Inheritance
Most relevant
Python Project: pillow, tesseract, and opencv
OpenCourser.com/course/6hvp2w/python
Python Project: pillow, tesseract, and opencv
Most relevant
Using Python to Access Web Data
OpenCourser.com/course/ridega/using
Using Python to Access Web Data
Most relevant
Basic Data Processing and Visualization
OpenCourser.com/course/26xjr8/basic
Basic Data Processing and Visualization
Python Functions, Files, and Dictionaries
OpenCourser.com/course/hjiesr/python
Python Functions, Files, and Dictionaries
Web Scraping with Python + BeautifulSoup
OpenCourser.com/course/cqi3n8/web
Web Scraping with Python + BeautifulSoup
Applied AI with DeepLearning
OpenCourser.com/course/ljl8m2/applied
Applied AI with DeepLearning
Using Sensors With Your Raspberry Pi
OpenCourser.com/course/12jkjm/using
Using Sensors With Your Raspberry Pi
Deploying Machine Learning Models
OpenCourser.com/course/hdf30i/deploying
Deploying Machine Learning Models
Level
Intermediate
Via
Coursera
Institution
University of Michigan
Instructor
Paul Resnick
Language
English
Transcripts
Español
Français
Português
Deutsch
Italiano
中文
العربية
한국어
日本語
हिंदी
Nederlands
Svenska
Pусский
Türkçe
Polski
Ελληνικά
українська мова
magyar nyelv
Bahasa Indonesia
ไทย
қазақша
اُردُو,
فارسی
বাংলা
tiếng Việt
پښتو
آذربایجان دیلی
This course belongs to a
collection
called
Python 3 Programming. It's comprised of five courses:
- Data Collection and Processing with Python (viewing)
- Python Project: pillow, tesseract, and opencv
- Python Classes and Inheritance
- Python Functions, Files, and Dictionaries
- Python Basics
Good to know
Develops core Python skills for data fetching and processing from services on the Internet
Builds on prior courses in the 'Python 3 Programming Specialization' series
Introduces the Python requests module for interacting with REST APIs and API documentation
Emphasizes list comprehensions and provides opportunities to practice extracting and processing deeply nested data
Culminates in a practical project of building a tag recommender for Flickr
Our mission
OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.
Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.
Find this site helpful? Tell a friend about us.
Affiliate disclosure
We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.
Your purchases help us maintain our catalog and keep our servers humming without ads.
Thank you for supporting OpenCourser.
© 2016 - 2024 OpenCourser