Getting Started
Overview | Interface | Beginner's Tutorial 1
Design Macro
Edit Macro: Record Actions | Add/Remove/Change Actions
Debug Macro: Step/Run to | Inspector[View Page Code] | Target XPath[Select Targets Correctly]
Steps to Fix the Project When Pages Changed
Details of Actions
Actions Connections and Execution Flow[Loop, Judge]
Common Attributes of Actions[XPath, Data, Before do Action]
URLs/Links Actions: Goto[Batch Add URLs] | Open Link(s)[Recursively] | Open More Link(s) | Multiple Threads(Browsers)
Scrape/Capture Actions: Scrape Page | Capture Content
Human Actions: Wait, Fill, Click, Check, Choose, Select, Scroll Down
System Actions: Run Code | Validate | Scrape Target Count | Log
Browser Actions: Run Javascript in Browser | Clear Cookies | Go back
Captcha Actions: Get/Input Captcha[Appear Randomly]
Data Manipulation
Export Format | Data Table | Inputting Data/Variables | Download Files from URLs in Data Table
Execution
Logs | Running Statistics[Handle Error Links] | Execute Externally[Command-line Parameters]
Settings
General[Timeout, Interval, Threads Count] | Scraping Settings | Anonymity[Proxies, Captcha, Useragent]
Run Settings[Clear Tables Before Run, Traverse Table Rows, Report After Run]
HOWTOs
- Relate tables with "Item Unique attribute(name, ID...)" or "URL" and "parent URL"
- Optimize execution speed
- How to select a range of targets
- How to scrape rows from a table
- How to traverse all "options" in a "select" control on page
- How to scrape full Ajax site without link
- How to judge it got last page when loop clicking "next" button or recursively opening "next" link
Frequently Asked Questions
- "Fminer cannot be opened because it is from an unverified developer" on Mac OS
- Scrape pages without "next page" links/buttons
- Failed loading page (Protocol "javascript" is unknown)
- Pages can't load correctly
- Error of "Export data fail -13Permission denied" when export data
- Can't select target that contain " " by "with text..."
- How to go back in browser
- Run project with login actions, it will fail when logged in
- I scraped X records, but export more data
- Firing a keyboard event
- Avoid crash, monitor execution for scraping big site
- Trial expired in 15 days or on full licensed computer
- Move license to another computer