Tag

Scraping

5 items tagged "Scraping"

Guides

Python Web Scraping Tools Compared: Which to Use

Beautiful Soup, Scrapy, Playwright and Selenium solve different scraping problems. See what each does, when it fits, and how to pick.

Web DevelopmentComparison

Resources

Beautiful Soup

Python library for pulling data out of HTML and XML files, with simple ways to search and navigate the parse tree

NewScrapingHtml

Playwright for Python

Browser automation library that drives Chromium, Firefox and WebKit, with auto-waiting and both sync and async APIs

NewScrapingBrowser

Scrapy

Application framework for crawling websites and extracting structured data, with built-in request scheduling and exports

NewScrapingCrawler

Selenium

Long-standing browser automation project whose WebDriver API controls real browsers, used for testing and scraping

NewScrapingBrowser