Save for later

Using Python to Access Web Data

Python for Everybody,

This course will show how one can treat the Internet as a source of data. We will scrape, parse, and read web data as well as access data using web APIs. We will work with HTML, XML, and JSON data formats in Python. This course will cover Chapters 11-13 of the textbook “Python for Everybody”. To succeed in this course, you should be familiar with the material covered in Chapters 1-10 of the textbook and the first two courses in this specialization. These topics include variables and expressions, conditional execution (loops, branching, and try/except), functions, Python data structures (strings, lists, dictionaries, and tuples), and manipulating files. This course covers Python 3.
Get Details and Enroll Now

OpenCourser is an affiliate partner of Coursera and may earn a commission when you buy through our links.

Get a Reminder

Send to:
Rating 4.7 based on 5,608 ratings
Length 7 weeks
Effort 6 weeks of study, 2-4 hours/week
Starts Jun 19 (50 weeks ago)
Cost $79
From University of Michigan via Coursera
Instructors Charles Severance, Charles Russell Severance
Download Videos On all desktop and mobile devices
Language English
Subjects Programming
Tags Computer Science Software Development

Get a Reminder

Send to:

Similar Courses

What people are saying

looking forward

Very much looking forward to starting that.

I'm looking forward to the next one (Using Databases with Python).

It certainly whetted my appetite for more, and I'm looking forward to the next class in the specialization and the opportunity to put my newfound skills to the test with work projects.

I was happy to complete the class and am looking forward to starting the next one.

I personally loved this course and am looking forward to the next.

A big thank you again to Dr. Chuck, and I'm looking forward to taking the next course - databases.

Overall a very good course and I am looking forward to learning more in the next two chapters.

Looking forward to Python and databases.

Looking forward to more classes!

Looking forward to taking more of his courses!

Looking forward to start the next course ASAP.

Looking forward to do more certifications with coursera.

I'm really looking forward to the next class in the series.

Looking forward to check out with his other courses in the future.

Read more

regular expression

Now I can do quite a lot : word extractors, access api's, regular expressions, accessing web data, parsing html, and more.

This course does a great job covering some powerful and important topics that generally don't show up in early programming/python courses: regular expressions and accessing web pages and resources from python.

The first 2 courses will teach you a great deal of the basics but this course goes more in depth, think of Regular Expressions, Sockets, XML and JSON and finally webservice-api's.

It covers advanced topics, and provides some hands on training in using Python libraries to scour web data (html mostly), read it, and find interesting bits in it, using regular expression.

I really liked the section on regular expressions and the interviews with the REST and JSON folks.

Learning about XML, JSON, APIs and parsing using regular expressions will be very useful at my job.

Excellent material and well presented Awesome course: Regular Expressions, SOA, APIs and a whole lot more.

Nice course to get familiar with XML, JSON, accessing web data and using API-s. Also, regular expressions are very well explained.

sockets and regular expressions were not explained very well.

Still this course provides me a good start and a broad understanding of what's going on with areas such as regular expression, XML, Json, API and python's connection with them.

This course is great to introduce you to regular expression, HTML, XML and JSON.

I learnt a great deal from this course starting from regular expression to JSON parsing,XML parsing, Rest APIs etc.

I have got a very handsome introduction to the regular expressions , web services and API .

Great as usual not as clear as the previous courses Especially loved the chapter on regular expressions.

Read more

python for everybody specialization

I really enjoyed the first two courses of Dr. Chuck's Python for Everybody Specialization -- but not this one.

This is the third course that I have completed under the Python for Everybody specialization.

As a continuation of the first two courses in the Python for Everybody specialization, this was more of the same great stuff: great professor, great lectures, and great content.

Hello, this is the third course of Python for everybody specialization I completed and I it is very well done, easy to understand, and full of information, examples and explanations.

The first of the Python for Everybody Specialization courses that is really demanding for a begginer.

This is the third course in the Python for Everybody specialization.

This is the third Cousera module I've completed as part of work towards the Python for Everybody specialization.

This is the third course of Python for Everybody Specialization that I have successfully completed.

It's the third course from the Python for Everybody specialization, and its really focused on teaching you how to code.

This course fits very well in the Python for Everybody specialization.

Another great course in the Python for Everybody specialization.

I'm also doing the Python for Everybody specialization and if you've taken any of Dr. Chuck's courses, you know he's hard to beat, but Dr. Matthew Yee-King did it.

The Python for Everybody Specialization is perfect for absolute beginners.

It is a great progressive step after completing the previous two courses of the Python for Everybody Specialization.

Read more

university of michigan

I'm glad I decided to pursue the entire specialization offered by University of Michigan, and it is all thanks to Dr. Chuck!

This is course three of five in the University of Michigan's Python for Everybody series and things start to become real.

Another thoroughly enjoyable Python course from Dr Chuck and the team at the University of Michigan.

This is the third course i have taken under Professor Charles Severance from University of Michigan.

I'm glad that I enrolled for this specialization offered by University of Michigan, and it is all thanks to Dr. Chuck!

Another great course from University of Michigan and Professor Charles Severance.

This is the 3/5 part of the python specialisation provided from University of Michigan.

Started learning programming thanks to Dr.Chuck/Coursera/University of Michigan; Not sure if I ever had the chance to learn programming otherwise.

Excellent course, and very good content of it, many thanks to Dr Chuck and the University of Michigan Great course.

Chuck, I understand that University of Michigan has to find a way to monetize these courses.

Thank you very much Dr Chuck and University of Michigan for this great Coursera´s course.

I'm going to take more classes from University of Michigan.

Dr. Charles Severance and the University of Michigan.Excellent course and very learning of easy.

Best course I am glad.. this is a second Python course with Dr. Chuck and University of Michigan.

Read more

computer science

I am actually able to have programming discussions with my friends who have a computer science and programming background.

Also, as a student of computer science, I really like that he goes out and interviews the people who were responsible for inventing, or discovering, various technologies (ARPANET, Linux, Arduino, JSON, etc).

I would have had a much better time earning my Computer Science degree if I would have had Dr. Chuck at UofM instead of most of the professors I had at my alma mater.

You do not need a degree in Computer Science to take and fully understand the course.

I highly recommend this course... especially for anyone new to Python and/or computer science.

It does not assume that you have a background in computer science or exposure to several programming languages.

I recommend everyone from computer science or any other field to take this really nice course This course and its predecessors are a great intro to Python.

But I advice first take edX course Introduction in computer science using Python (it takes more time but more deeper in Python) and then this course as supplementary one.

The bonus videos are also very interesting, allowing one to meet some of the anonymous greats of computer science.

This course is great to have an insight in different fields of computer science via python.Dr Chuck inspires to learn with his amazing sense of humour.

It is totally free which is special on Coursera and all the skills I learnt from this course is really helpful That is really good class for someone like me that who do not have a computer science background.

The assignments and quizzes tests your knowledge on some of the important and underlaying details of python programming language that would definitely help me as a programmer and in computer science Thank~~ I liked it Awesome course, easy to follow, good working examples to teach core concepts.

making it simple to get familiar with programming ,coding and the world of computers and help to start in the field of computer science with ease Great course, enjoyed the lectures.

I appreciate a lot the efforts of Dr.Chuck made in computer science education.

Read more

step by step

The lecturer is very good in explaining the step by step process on coding as well as on what each syntax means.

I don't think I could have learned all I have except that Dr. Chuck takes things step by step through the process.

Led me step by step to perform more and more interesting and challenging stuff, such that completing an assignment or understanding a lesson thoroughly was always a source of great satisfaction.

I quite enjoy the fact that the assignments are not given to us step by step but instead make us think through what is required.

A clear, step by step introduction to using python to get and parse information from the WEB - using URLLIB, XML and JSON Nice class with Dr. Chuck!

Very tidy and step by step course.

As always, Dr. Charles' magnificent pedagogy will guide you step by step up to the point where you will be sending requests and fetching data from your Twitter account.

And I missed the teaching of good pythonic programming style (something that is more than just script step by step but encapsulate functionality in functions, use advanced programming techniques, test your code and so on).

I'd like this course to be more difficult and i'd like it to have more practical exercises Dr Chuck is scaffolding step by step your skills in python in a cozy way.

Dr Chuck takes you step by step through the process of accessing data from web pages and services.

Learning how to get the web data step by step.

The homework are more difficult than before, however; which will not be a problem if you follow the course step by step.

The step by step explanation of various code types made it easy to follow the logic and flow I find this course very useful and informative , I really enjoyed the lessons and the teaching process is very well designed.

Made a technical subject fun and enjoyable to learn with many examples shown step by step.

Read more

beautiful soup

The material was too cursory on HTML web scraping with Beautiful Soup and reading XML.

If Dr. Chuck could augment the material on Beautiful Soup and XML, the course would be perfect.

Help you learn a lot on subject, covering lot of topics as sockets, xml, jason, beautiful soup, etc... Great course for anyone who wants to learn how to code in python.

Granted, this is still a broad overview and we didn't dive too deep (this is a good thing) into REGEX, XML, JSON, along with different libraries (urllib, beautiful soup, etc) but I'm no longer intimidated by the terms and have a great understanding of at least what they are and why there are used.

Assignments should have been made more difficult and more in depth explanation of Beautiful Soup package is highly recommended.

Assignment samples didn't match up for the xml parsing section... json code was provided.... spend hours getting beautiful soup to work then figured out they had switched the python version on me.... course forum was worthless One of the best python course available online.

Excellent demonstration of Beautiful Soup and JSON.

Great course and fantastic series it would be 5 star rating if you will provide the deep detail or other practice exercise for Beautiful soup json and rest apioverall great course learn api and i am using Beautiful Soup now very often The course is excellent for anyone who wants to build on their Python Knowledge, build a little Web Application interacting with an API or generally pull data from the Web using Python for any purpose.Dr.

Most of the course is useless to me because python 2 and python 3 are very different with beautiful soup and this and that.

Beautiful Soup was introduced as a way to do things, but not thoroughly explained as a package.

Additionally, it provides a lot of value by effectively stringing a series on mini courses on specific standard Python libraries, which is something not found everywhere:* the regular expressions library* libraries for web communication (socket and urllib) * parsing HTML (beautiful soup)* data transfer libraries (XML and JSON) Excellent Thank You!

Each assignment boiled down to parsing a file using specific method (reg ex, Beautiful Soup, XML, or json libraries) to do the same task.

With all the Python modules used in this course (Beautiful Soup, ET, XML, JSON) you are bound to come across situations where reading the documentation will open up many new pathways and enhance your understanding.All in all a fun learning experience.

The positive side, it introduces you to Web API's, the basics of Beautiful Soup, and other BUZZWORDS.

Read more

once again

Once again, another excellent course from Dr. Chuck.

This is my third Dr. Chuck course on Coursera and, once again, I am surprised with how much I learned.

Once again A+, I feel very comfortable with what I am learning.

But an amazing job once again fro Dr.Chuck .

Charles is an amazing teacher :) Once again, great course!

I've used this course to scrape fantasy football data and analyse it in Excel Once again, another excellent course from Dr. Chuck.

once again only matter the ability to make it simple There were so many new libraries and concepts introduced in the last two chapters.

Once again, an amazing course from Dr. Chuck!

Once again, it offers a great mix of practical knowledge and the broader background on all topics.

Great course once again!

Once again, thanks for Professor Severance and all the staff supporting this specialization!

Also use the forum if you need to--if you have already programmed before and sailed through the first two classes in the specialization, this class may surprise you with its increased rigor but once again Dr. Chuck and his staff on the forum will get you up to speed.

once again thank you all !

Read more

real world applications

This class did a great job of building on prior Python classes while advancing into more real world applications.

It covers the basics and extends to real world applications.

I feel like I'm starting to get closer to real world applications with Python and its very exciting.

非常好的课程!推荐给所有人! Good course Easy to follow, teach some basic skills and background informationThis course is helpful for beginners, not for majors Very motivated teacher This course is especially interesting as you begin to use some of the earlier building blocks in real world applications.

It would have helped if the problem sets were more challenging and in tune with real world applications.

It covers many aspects of API and how to use them in real world applications.

Great course in the python series.Got introduced about API and how to use it in the development of real world applications This course give a good introduction about how to communicate with web data in python.

Read more

excelente curso

But, of course, his explanations were perfect, he is just passionate about transmitting the information to the students in the easiest to understand manner.And I have to say he succeeds admirably.Overall, I highly recommend this course Excelente curso para aprender mas de lenguaje python y las tecnologias existentes en internet Not only interesting but also practical for all those interested in treating the web as a source of structured information.

:) i don't understand how but i did it :) Es un excelente curso muy completo !!

an useful introduction to use python to access web data Great practical introduction to python I had finished 4/5 courses of Python, but the last course is always not able to access... wonderful experience Excelente curso para aprender el lenguaje python y reafirmar los estandares protocolos y servios html This course has helped to gain lot of knowledge on Web crawler and testing Web services through Python.

Excelente curso.

I love his teaching Very good course 这个老师的课很简单易懂,我会继续学相关课程3.但这属于基础入门课,没有太多知识储备的人都能懂。但能培养兴趣。 Excelente curso, muy didáctico, muy bien organizado Best course to learn the basics of accessing web data and professor chuck is lovable as ever!!

_(:3 」∠)_(用中文好了)这个章节字幕君牺牲了,全程英文,给我造成了一些困难,好在课程很基础,对于非计算机专业的人来说(比如我)已经足够了。老师还是一如既往的逗。 This course helped me to understand a lot of things, and gave me the knowledge to create my own web scrapper tool for my web app I could have all basic knowledge in accessing web data using python.Thank you professor!and Thank you Coursera excelente curso con temas concretos y se ven de manera rápida.

excelente curso A straight forward course so far.

I love this course Excelente curso para los principiantes Brilliant class.

Excelente curso!

Grow up man..:( Excelente curso.

Read more

great sense of humor

Love to attend any future courses teaches by Professor Charles Severance, he is the real deal with great sense of humor.

Down to earth, knowledgeable, with a great sense of humor.

Great teacher, with a great sense of humor.

Interesting CONTENTBest ExplanationQualitative Assignments fast learn very good for lerning I just loved it.Got to know interesting things how we can hit to URL how can we fetch data from various sources and retrive it good course to start with Dr.Chuck's great sense of humor enabled a fun learning experience.

Read more

about regular expressions

Great course, learned a lot more than intended as my focus was learning about regular expressions.

You will get to know about regular expressions, basics of web, APIs, XMl, JSON and scraping.

A student is bombarded with information about regular expressions, the HTTP protocol, web sockets, URLs, HTML, XML, JSON, and APIs.

While the first lesson about regular expressions really adds to the first courses, after this we are served with piece-meal portions of content that fail to grasp a deeper understanding of the topics being covered.

Well, i have completed this course now and i find it very helpful, regardless of what other people think about this course i would say my expectations are met, my objective was to learn about the background of accessing internet using python in addition i learned about regular expressions and api which is very helpful.

Very great, it might be a fundamental course but, it contains very useful info about Regular Expressions, Networking, Sockets, Transfering data, URL library, Beautiful soup, XML and its Schemas, JSON and some APIs including Google Geocoding and Twitter API not bad helps me a lot to understand the parsing of json and xml Great course, full of useful information Good Course This course is very lively and interesting.

Read more


An overview of related careers and their average salaries in the US. Bars indicate income percentile.


Data 1 2 $50k

Data 2 $50k

Data Scientist - Big Data $68k

Data Scientist - Data Curation $92k

Data Analyst, Data Warehousing $93k

Data Analyst - Portfolio Data $93k

Data Scientist / Data Visualization $107k

Data Administrator / Data Modeler $108k

Data Integration Engineer| Data Warehouse $116k

Data Analyst/Data Modeler $116k

Data Architect Data Warehouse $167k

Write a review

Your opinion matters. Tell us what you think.

Rating 4.7 based on 5,608 ratings
Length 7 weeks
Effort 6 weeks of study, 2-4 hours/week
Starts Jun 19 (50 weeks ago)
Cost $79
From University of Michigan via Coursera
Instructors Charles Severance, Charles Russell Severance
Download Videos On all desktop and mobile devices
Language English
Subjects Programming
Tags Computer Science Software Development

Similar Courses

Sorted by relevance

Like this course?

Here's what to do next:

  • Save this course for later
  • Get more details from the course provider
  • Enroll in this course
Enroll Now