Important Yelp Scraper News.
UPDATE: Please see the newest blog post about the issue. We now have a working Yelp scraper again.
Major news today from Yelp.com. Yelp has now hired Distil Networks to police the traffic on their website. Distil is a major anti scraper/anti bot protection company and this is going to have a major affect on our scrapers. We will no longer be able to scrape Yelp the way we have been.
Today I will begin work on creating a new scraper that will work around their protections. This new yelp scraper will require the use of proxies and will probably no longer be multithreaded. We should be able to continue scraping their website but how we do it will need to change.
Because of this the Yelp scraper is officially DOWN until further notice. This update may take several days or longer to get something working again.