Web Crawler

There's one shop who resells goods from lots of other shops. They needed to collect huge amount of data about the products from those shops and keep it updated.

The problem though - they can't use existing crawlers because most of it can't craw JS heavy sites, only HTML ones.

I created Web Crawler that uses Real Browser and being able to parse any site and processing hundreds of thousands products every day to keep the prices and other product data always up to date.

If you are interested about the Web Crawler and how it works please take a look at the articles Crawling JavaScript Sites, Making Crawler Fast and Reliable or the Parsing Web presentation.