Ticket #5255 (new defect)

Opened 2 years ago

Last modified 2 weeks ago

Cannot import more than 500 records

Reported by: prasad Assigned to: kaveri
Priority: major Milestone: 5.2.0
Component: vtigercrm Version: 5.1.0
Keywords: Cc:

Description

When trying to import 800 records, the screen goes blank but I see only 500 records imported and is shown in the list view.

Attachments

vtiger-504-import-records.patch (1.7 kB) - added by prasad on 04/04/08 09:32:06.
vtiger-504-import-records.patch

Change History

04/04/08 09:28:12 changed by prasad

The number of records import at one time is defined in modules/Import/ImportStep2.php

$_SESSIONrecordcount? = 500;

File: modules/Import/ImportStep3.php deletes the data file used for importing after reading the contents first time. So the second invocation of import will fail to import any more data.

The data file used for import should be deleted only in the last step.

04/04/08 09:32:06 changed by prasad

  • attachment vtiger-504-import-records.patch added.

vtiger-504-import-records.patch

04/04/08 09:32:37 changed by prasad

I have found the fix for this issue and have attached vtiger-504-import-records.patch this ticket. Kindly validate it further.

04/23/08 08:53:06 changed by carlo.beschi

I applied the patch to two different 504 installations today. The fix seems to work fine :-)

06/25/08 06:40:17 changed by asha

  • status changed from new to closed.
  • resolution set to fixed.

This issue has been fixed and integrated. Please refer to the changeset #12068

08/05/09 14:16:33 changed by thomaslinp

  • status changed from closed to reopened.
  • version changed from 5.0.4 to 5.1.0.
  • resolution deleted.

This is still a problem in version 5.1.0

You may change the /modules/Import/ImportStep2.php line 45 from

$_SESSION['recordcount'] = 500;

to

$_SESSION['recordcount'] = 7000;

Make sure that php.ini (at least on Linux) can execute for a long and time and is allowed to use quite some memory:

My /etc/php.ini

max_execution_time = 6000     ; Maximum execution time of each script, in seconds
max_input_time = 6000   ; Maximum amount of time each script may spend parsing request data
memory_limit = 2048M      ; Maximum amount of memory a script may consume

12/23/09 07:04:25 changed by musavir

we are not able to reproduce the issue with vtigercrm 5.1.0 GA, it would be good if you can share more details perhaps with the file. so we can nail down the issue.

12/23/09 07:04:43 changed by musavir

  • milestone changed from 5.1.0 to 5.2.0.

01/05/10 23:36:49 changed by secondcrm

Last month when we were importing lot of data, we faced this problem many times in many modules [accounts, contacts, service contracts, etc]. Though there is no consistency as the same module appears to work fine at times. The way it behaves is import 500 records fine and then keep refreshing the page again and again till the all the records are complete [for example if there are 3000 records it will refresh 6 times, with correct success message, but importing only first 500].

01/26/10 23:15:40 changed by kaveri

  • status changed from reopened to new.
  • owner changed from developer to kaveri.