Python and the Web – Using urllib and Requests

From the previous chapter, we now have an idea about what web scraping is, what the core development technologies that exist are, and where or how we can plan to find the information we are looking for.

Web scraping requires tools and techniques to be implemented and deployed using scripts or programs. The Python programming language consists of a huge set of libraries that are fit for interacting with the web and for scraping purposes. In this chapter, we will communicate with web resources using Python; we'll also explore and search for the contents to be extracted from the web.

This chapter will also provide a detailed overview of using Python libraries such as requests and urllib.

In particular, ...

Get Hands-On Web Scraping with Python now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.