Scrape Pages Without "next page"


Some pages have no "next link",  just show 1, 2, 3, 4, 5, 6 ,7 ,8 ,9 10, when got to page 10, it will jump to 10, 11, 12, 13, 14. For this kind sites:


If the links are the real links and can be used with "openlink(s)"

You can select all pages links(2,3...) as the next links, FMiner will open these links recursively without duplication.


If the links are ajax buttons

In most cases, you can make the XPath of the “click action” smart to find “next page button” automatically. For example, when current page is 1, it will locate page 2, when got to page 2, it will locate page 3. To do this:

1. Select current page number, and make it work when page change with change target xpath

2. Use “Relativily select” to select the first link right of it. 

If this way can't work, you have to make a loop to click each button.