Book description
If programming is magic, then web scraping is surely a form of wizardry. By writing a simple automated program, you can query web servers, request data, and parse it to extract the information you need. This thoroughly updated third edition not only introduces you to web scraping but also serves as a comprehensive guide to scraping almost every type of data from the modern web.
Part I focuses on web scraping mechanics: using Python to request information from a web server, performing basic handling of the server's response, and interacting with sites in an automated fashion. Part II explores a variety of more specific tools and applications to fit any web scraping scenario you're likely to encounter.
- Parse complicated HTML pages
- Develop crawlers with the Scrapy framework
- Learn methods to store the data you scrape
- Read and extract data from documents
- Clean and normalize badly formatted data
- Read and write natural languages
- Crawl through forms and logins
- Scrape JavaScript and crawl through APIs
- Use and write image-to-text software
- Avoid scraping traps and bot blockers
- Use scrapers to test your website
Publisher resources
Table of contents
- Preface
- I. Building Scrapers
- 1. How the Internet Works
- 2. The Legalities and Ethics of Web Scraping
- 3. Applications of Web Scraping
- 4. Writing Your First Web Scraper
- 5. Advanced HTML Parsing
- 6. Writing Web Crawlers
- 7. Web Crawling Models
- 8. Scrapy
- 9. Storing Data
- II. Advanced Scraping
- 10. Reading Documents
- 11. Working with Dirty Data
- 12. Reading and Writing Natural Languages
- 13. Crawling Through Forms and Logins
- 14. Scraping JavaScript
- 15. Crawling Through APIs
- 16. Image Processing and Text Recognition
- 17. Avoiding Scraping Traps
- 18. Testing Your Website with Scrapers
- 19. Web Scraping in Parallel
- 20. Web Scraping Proxies
- Index
- About the Author
Product information
- Title: Web Scraping with Python, 3rd Edition
- Author(s):
- Release date: February 2024
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 9781098145354
You might also like
book
Web Scraping with Python, 2nd Edition
If programming is magic then web scraping is surely a form of wizardry. By writing a …
book
Hands-On Web Scraping with Python - Second Edition
Work through practical examples to unlock the full potential of web scraping with Python and gain …
video
Web Scraping Tutorial with Scrapy and Python for Beginners
Web scraping is the process of scraping websites and extracting desired data from them, and in …
book
Head First Python, 3rd Edition
What will you learn from this book? Want to learn the Python language without slogging your …