• You are not logged in.

#1 Jan. 27, 2013 06:05:51

sketman
Registered: 2013-01-22
Posts: 13
Reputation: +  0  -
Profile   Send e-mail  

Export projects with more than 65.536 rows

Hello!

I am just scraping a databse of records with more than 100 000 rows. When I paused the project and tryed to export the data I got error message saying that maximum of 65536 rows was exceed.
I am getting this error when exporting into .xls and into .csw as well.

Can this limit be removed please?

I know that older versions of Excel (.xls files) have that limit in maximal allowed rows. However .xlsx files does not have that limit I think.
Also .csv files should not have any limits…

Offline

#2 Jan. 29, 2013 19:40:03

admin
Registered: 2012-03-15
Posts: 289
Reputation: +  1  -
Profile   Send e-mail  

Export projects with more than 65.536 rows

Yes .xls have limit of 65536, and I will try to add support of xlsx format in next version.
But .csv have no limit, I tested a big project with this format before without any problem, do you sure you changed the exporting format to csv before export the data? When changed, the text on the “export” button will change to “export (csv)”.

If you really has problem of csv exporting, please tell me the error message, I will make more tests.

Offline

#3 Jan. 29, 2013 19:58:46

admin
Registered: 2012-03-15
Posts: 289
Reputation: +  1  -
Profile   Send e-mail  

Export projects with more than 65.536 rows

I just tested to export 120 000 rows to csv format, and have no problem.

Offline

#4 Jan. 30, 2013 03:32:36

admin
Registered: 2012-03-15
Posts: 289
Reputation: +  1  -
Profile   Send e-mail  

Export projects with more than 65.536 rows

Now I've add support for xlsx format exporting in version 6.57. Please try it.

Offline

#5 Jan. 31, 2013 02:35:36

sketman
Registered: 2013-01-22
Posts: 13
Reputation: +  0  -
Profile   Send e-mail  

Export projects with more than 65.536 rows

Hello,

I apologise regarding the CSV export. It really works well, as you described. The problem was that I was trying to open the file with Open Office (probably its an older version), where the maximal row count is limited to 65536. I tryed to open it Excel 2010 and it worked fine. Thank you.

I have also tryed the new xlsx export feature. Unfortunately it did not work for me.
1. Export to xlsx went fine, without issues
2. When opening in Excel I got message saying that Excel found an unreadable content in the file and asking if I want to restore the content.
3. After clicking on Yes I got another error message saying the Excel could open the file after removing unreadable parts of the file.
4. the final result is an empty sheet. It has a lot of rows, as if there were data, however everything is empty.

Offline

#6 Jan. 31, 2013 07:05:12

admin
Registered: 2012-03-15
Posts: 289
Reputation: +  1  -
Profile   Send e-mail  

Export projects with more than 65.536 rows

I found when the data start with ‘=’, program will try to convert it to ‘formula’ format, and will error, I've made an new version 6.58 fixed this problem, please try the new version to export xlsx file.

Offline

#7 Feb. 4, 2013 08:22:36

sketman
Registered: 2013-01-22
Posts: 13
Reputation: +  0  -
Profile   Send e-mail  

Export projects with more than 65.536 rows

Hello,
sorry, but still the same behavior, the same error. Nothing has changed…

Offline

#8 Feb. 4, 2013 08:23:10

sketman
Registered: 2013-01-22
Posts: 13
Reputation: +  0  -
Profile   Send e-mail  

Export projects with more than 65.536 rows

Just forgot the info - I am running the Fminer 6.58

Offline

#9 Feb. 4, 2013 08:39:23

sketman
Registered: 2013-01-22
Posts: 13
Reputation: +  0  -
Profile   Send e-mail  

Export projects with more than 65.536 rows

Also I am experiencing the following strange behavior: when I want to export the scrapped results, it often start exporting but does not finishes it and closes (shuts down) the entire application.
My current database I am scrapping is relatively large, more than 210.000 records…

Offline

#10 Feb. 21, 2013 21:15:51

admin
Registered: 2012-03-15
Posts: 289
Reputation: +  1  -
Profile   Send e-mail  

Export projects with more than 65.536 rows

Please send the your fmp file to my email: support@fminer.com thanks.
I will try to test it, without the project file, I can't find the where the bug.

Offline

Board footer

Moderator control

Powered by DjangoBB