• You are not logged in.

#1 Dec. 2, 2013 00:31:39

mave27
Registered: 2013-12-02
Posts: 10
Reputation: +  0  -
Profile   Send e-mail  

How does FMiner capture email, Website & GeoData co-ordinates from Yellow Pages (Ke) ?

Hey - i'm having a go at the trial version of the FMiner to scrape Yellow Pages (Ke).

I managed to scrape the basic info, but i also want to capture email, website URL & GeoData co-ordinates.
Can FMiner also capture this info as email/website details are LOCKED (HIDDEN) thro' Submission Form. The GEO DATA isn't showing on Google Map.

Pls advise

Attached is sample CSV output of Car Hire Companies successfully captured from link below:
http://yellow.co.ke/branches/listing/category:car-hire

Thanks.

Attachments:
attachment yellow.xls (31.0 KB)

Offline

#2 Dec. 2, 2013 01:40:19

admin
Registered: 2012-03-15
Posts: 289
Reputation: +  1  -
Profile   Send e-mail  

How does FMiner capture email, Website & GeoData co-ordinates from Yellow Pages (Ke) ?

I've studied the page, and can tell you: it's impossible to get email from the page, the site hide the email on its server, and just can get link like this: http://yellow.co.ke/contacts/business_enquiry/64891 but you can't get the real email addres from the page.

I'm not family with GEO, and make some test on page, but failed to get the data. I will tell you the way to do this, you can try by yourself:

1. At first, you must find the real GEO from page or url, I do this in chrome, you can open “developer tool” in chrome, and check the page content in “Elements” table, if you can't find real GEO data, try to switch to “network” table, here are many links, and some link like:

http://mt1.googleapis.com/vt?lyrs=m@245007878&src=apiv3&hl=zh-CN&x=39989&y=33506&z=16&style=47,37%7Csmartmaps

here are data: x=39989 y=33506, I though these are GEO data, but they are not, because I tested different address, and these data are very close, these should not be real GEO data. You can try other urls or data to find the real data. I failed in this step.

2. Suppose you get real GEO data, for example 39989, then you can switch to “Elements” table in chrome, and search it(39989) here, if you find an element with this data. You can know “xpath” of this element according to the source code, and then scrape it in FMiner.

If you can do the first step, get the real GEO data from the page, I can help you to scrape it with FMiner, or I have no idea to do it.

Edited admin (Dec. 2, 2013 01:41:45)

Offline

#3 Dec. 4, 2013 01:38:16

mave27
Registered: 2013-12-02
Posts: 10
Reputation: +  0  -
Profile   Send e-mail  

How does FMiner capture email, Website & GeoData co-ordinates from Yellow Pages (Ke) ?

Thanks for prompt response.

OK - since it's not possible to get the email & GEO Data, can you get the Website URL ?

Demo version FMiner isn't capturing the Website URL from link

http://yellow.co.ke/branches/listing/category:car-hire

I'm happy to work without GEO Data & Email, but i need rest of info from page incl Website URL

Rgds

Offline

#4 Dec. 4, 2013 06:05:50

admin
Registered: 2012-03-15
Posts: 289
Reputation: +  1  -
Profile   Send e-mail  

How does FMiner capture email, Website & GeoData co-ordinates from Yellow Pages (Ke) ?

Done a demo for this site, it will scrape “name”, “mobile”, “site” of every items. You can add other “capture content” actions to scrape other things.

And if you want we make a full project for you, please submit the detail of the project here: http://www.fminer.com/request_project/, we will make it for you, and you pay $99 for it when we finish it.

Attachments:
attachment yellow.fmpx (43.9 KB)

Offline

#5 Dec. 5, 2013 00:44:58

mave27
Registered: 2013-12-02
Posts: 10
Reputation: +  0  -
Profile   Send e-mail  

How does FMiner capture email, Website & GeoData co-ordinates from Yellow Pages (Ke) ?

Great. Sound good.

I'm getting Error 404 Page Not Opening.
http://www.fminer.com/request_project/

Pls rectify so i can proceed with project initiation & payment.

Below is the info I need for ALL the listings on the site
http://yellow.co.ke/

  • Name: Glory Car Hire Tours & Safaris Ltd - Msa
  • Address: Main Mombasa Office, Glory House, Moi Ave, P.O. Box 85527-80100, Mombasa, Kenya
  • Mobile:+254722388729
    Tel:+254412313561
    Fax:+254412221196
  • Description: Glory car hire tours and safaris Msa ltd, was founded in 1980 by brothers Mr.Shaukat Noorani and Mr.Shabir Noorani. They started up with two saloon cars and a vision “to put everyone in the driver’s seat”. By 1990 they opened up their second office in Nairobi and had by then expanded their fleet. In 1993 they opened up their Malindi and Diani branch offices.In the year 2006 the brothers with their vision still going strong decided to divide the family business so as to venture into other business.Mr.Shaukautt Noorani took on his son as a director of his Mombasa based business. Together they expanded the Mombasa business to not only include car hire but also hotels with branches in Nairobi and Mombasa.
  • Timings: Monday - Saturday: 8:00am - 5:00pm; Sunday, Public Holidays, Closed

Sample Data from link below:
http://yellow.co.ke/business/glory-car-hire-tours-safaris-ltd-msa/79846/Glory%20House,%20Moi%20Ave,%20Mombasa,%20Kenya/Car%20Hire%7C%20Hotels/Glory

Offline

#6 Dec. 6, 2013 01:36:34

admin
Registered: 2012-03-15
Posts: 289
Reputation: +  1  -
Profile   Send e-mail  

How does FMiner capture email, Website & GeoData co-ordinates from Yellow Pages (Ke) ?

Sent the project to your email.

Offline

#7 Dec. 6, 2013 05:53:48

mave27
Registered: 2013-12-02
Posts: 10
Reputation: +  0  -
Profile   Send e-mail  

How does FMiner capture email, Website & GeoData co-ordinates from Yellow Pages (Ke) ?

Hey -can somebody pls explain why the attached sample Project is ONLY scraping the 1st TWO Listings & skipping the rest ?

Thanks.

Attachments:
attachment yellow_test2.fmpx (49.0 KB)

Offline

#8 Dec. 6, 2013 06:13:04

mave27
Registered: 2013-12-02
Posts: 10
Reputation: +  0  -
Profile   Send e-mail  

How does FMiner capture email, Website & GeoData co-ordinates from Yellow Pages (Ke) ?

admin

Hey - I tested the custom project template & isn't working.

It;s NOT scraping anything at all.

Perhaps, you might want to send the FINAL CSV as PROOF that it's working ?!

Offline

#9 Dec. 6, 2013 10:37:20

mave27
Registered: 2013-12-02
Posts: 10
Reputation: +  0  -
Profile   Send e-mail  

How does FMiner capture email, Website & GeoData co-ordinates from Yellow Pages (Ke) ?

Hi . - I have replied to your email. How do I execute the project ? Pls advise.

Thanks

Offline

Board footer

Moderator control

Powered by DjangoBB