Popular posts

I need to make this programmatically and after execution to return me object which I can manipulate.

For example:

Scrape all images and/or <li class="info"> tags li so:

parser = new Parser('li.info');

And then query the DOM and so on..

Vladimir Kyuchukov well you can do this with regex which would be transferable between languages or you can do it with a parser.

php.net/manual/en/class.domdocument.php this for example would be the php standard object for that.

does this help ? :)

I will try later and I will share you the results. Thank you, mate :)

j Is this good too for XML crawling? I need to automate downloading a certificate.

Emil Moe wouldn't you use simplexml for that ?

otherwise i would go for symfony.com/doc/current/components/dom_crawler.ht…

it's pretty neat.

Vladimir Kyuchukov this could interest you as well.

So I managed to do some stuff, but It appears I need scraper for dynamically created page. Pagination is dynamic. There is no query params which I can use. The website is written in react and everything is JS.

Selenium is a good tool for this case, but can be used with anything different than Python.

Vladimir Kyuchukov selenium is java. it's the common BDD brower tool for most applications. I think it uses an XML interface so it should be able to interface with any language.

you might want to look at Behat a PHP BDD tool which interfaces with it.