PDA

View Full Version : Next page with Javascript site navigation?


Frank
25th April 2007, 03:38 PM
Hello,

I’m new working with the UMS script, and have to learn a lot to reach the level I know about windows software like Websundew. I hope that everything that is possible with that piece of software is also possible with UMS! I do like this automated script!

My question:
I try to get data form the website sunweb.nl, especially from the specials page:

http://zon.sunweb.nl/nl/prd_sz/offers/index.aspx?lng=nl

But the problem is that the next page site navigation is done with javascript.

… (javascript:__doPostBack('Paginate','1');)


How is it possible with UMS to crawl the next pages in this case?

It has to fit is this tiny simple code I created witch extracts only the first page.

<Section>

Name sunweb.txt

<Action ContentURL>

URL http://zon.sunweb.nl/nl/prd_sz/offers/index.aspx?lng=nl
RemoveNewLine
</Action>

<Section While>
<Pattern>

RegExp <p class="offerTitle">{$main_title}</p>

</Pattern>

<Action Print>

Text {$main_title}\n

</Action>


</Section While>

</Section>

Main sunweb.txt

Thanks in advance for some help!

Frank,
The Netherlands

jperdoch
19th June 2007, 08:45 PM
Hi,
it's classic .NET website. There are several information sending by post in each pagination request. Therefore you need to simulate javascript - parse all needed values (__EVENTTARGET, __EVENTARGUMENT, __LASTFOCUS, __VIEWSTATE) and send them by POST in Action ContentURL. Also, very helpful can be some http sniffer for you, because you can exact to see, which information is browser sending back.