How to Set Up the Scrapy Splash Plugin

Scrapy is great for scraping static web pages with Python, but when it comes to dynamic pages it can only do so much. That&#x27;s where Selenium usually comes in, but as good as Selenium is, Scrapy still beats it in terms of speed. The web these days is full of dynamic JS-based pages and AJAX. For exactly that scenario, the folks over at scrapy-plugins created scrapy-splash . Scrapy-Splash is a…