• You are not logged in.

#1 Dec. 20, 2014 15:15:14

Armen
Registered: 2014-12-15
Posts: 8
Reputation: +  0  -
Profile   Send e-mail  

Scrap pages without next button and return to the previous page

admin
Armen
I have same problem trying to go next page. bat i dont know how to do that can you help me please. Give me some example file to i can work on it. Here is the link http://www.getauto.com/for-sale/acura-1?zip=92620&fromyear=1995&toyear=2015&fromSRP=On i make a group links works fine bat only i can scrap 25 to 50 data from the page. I need to go page 2,3,4 Thanks

This project is no different as this tutorial: http://www.fminer.com/scrape-multiple-yellow-pages-following-next-link/ Just add “openlinks” with “recursively” attribute can make it work. Try attachment.


Thanks I see that, bat i want to open group links and get data from in side the links, name vin Numbers and car options. I can get everything fine only i dont know how to redirect next page

Offline

#2 Jan. 12, 2015 19:09:03

Armen
Registered: 2014-12-15
Posts: 8
Reputation: +  0  -
Profile   Send e-mail  

Scrap pages without next button and return to the previous page

Can anyone help please. I want to scrap data from this site http://usedcars.automobilemag.com/5_2_1_1/used_acura_for_sale.html?NumListingsPerPage=100 Bat I want to get group link and get data from inside the detail page like vin, miles,colors,etc. I can get all this done with group select bat i dont know how go next page. Can someone give me direction how to do it. Thanks

Offline

#3 Jan. 13, 2015 04:13:48

admin
Registered: 2012-03-15
Posts: 289
Reputation: +  1  -
Profile   Send e-mail  

Scrap pages without next button and return to the previous page

You should add a “open links” recursively action for “next” page, and add “group select” “openlinks” follow it.
Note: with my test for this site, the “LISTINGS PER PAGE” will be 15 by default, and will change 100 to 15 when you open next link(not click), you should begin from http://usedcars.automobilemag.com/5_2_1_1/used_acura_for_sale.html

Try the demo.

Attachments:
attachment test.fmpx (40.5 KB)

Offline

#4 Jan. 18, 2015 17:03:27

Armen
Registered: 2014-12-15
Posts: 8
Reputation: +  0  -
Profile   Send e-mail  

Scrap pages without next button and return to the previous page

Thanks Works perfect

Edited Armen (Jan. 18, 2015 17:04:27)

Offline

#5 Feb. 6, 2015 15:37:34

Integral
Registered: 2015-02-06
Posts: 1
Reputation: +  0  -
Profile   Send e-mail  

Scrap pages without next button and return to the previous page

admin
Here's “open more link(s)” action for this situation, you can add this action as another child of a action. “open more link(s)” is a special action, actions can add more than one of it as children. It's some like “open link in new browser” in common browser. I've changed the project, see attachment.

Could you tell how you built the open link action. Is it a done using the select target and then the multiple target or by a grouping link with Grouping option. I tried it for my own scrapping project and it didn't works.

Thanks

Offline

#6 Feb. 10, 2015 14:38:49

suriya2687
Registered: 2015-02-10
Posts: 6
Reputation: +  0  -
Profile   Send e-mail  

Scrap pages without next button and return to the previous page

Hi Admin,

I have facing some issues with nexpage. I need to extract data within a loop of “next” pages,
Here I have attached my project file. Please review and let me know further updates.
In below URL:
http://www.lawyers.com/

Step 1: Fill State: California, USA
Step 2: Click Search
Step 3: Select NextPage with open link recursively
Step 4: Getting data from each link

Each page have 25 links, collect information on each link after its failed on next page.
Please suggest and advise me.

Thanks,
Suriya

Attachments:
attachment lawers.fmpx (77.6 KB)

Offline

Board footer

Moderator control

Powered by DjangoBB