I'd like to introduce
parselcli an command line application for evaluating css and xpath selectors in your terminal.
Explore ways to properly loop scrapy crawlers with twisted callbacks.
Why do we crawl websites? What projects are being born from gathered public data and how can that help a business or society as a whole?
Initial commit - starting a blog about web crawling! Initial plans, ideas and overview of what's to come! 🕷