Crawler

Scrapy

Application framework for crawling websites and extracting structured data, with built-in request scheduling and exports