@Madibalive curious if you are gonna open a repo on github on this? Be cool to see working example with cheeriojs, x-rayjs, nightmarejs, or phantomjs etc used along with one of these node packages mentioned by @Madibalive .
hey , am using only x-ray as it both paginates and crawl, as it if am going to open source , i can really tell it currently on hosted on bluemix i might think about it ,your the only showing interest so, would probably do a lite version to github( would reply back in 3 days with the url )