with 128mb memory limit per process i can import only xls files with 20000 rows.

can phpexcel work with batch api or how we can do import big files (100000 rows per xlsx file max)

Comments

ionmedia’s picture

here i see http://phpexcel.codeplex.com/discussions/240375 what phpexcel can use cache

// Initiate cache
 $cacheMethod = PHPExcel_CachedObjectStorageFactory::cache_to_phpTemp;
 $cacheSettings = array( 'memoryCacheSize' => '32MB');
 PHPExcel_Settings::setCacheStorageMethod($cacheMethod, $cacheSettings);

how i can enable it ?

ionmedia’s picture

after tests i see what this

function phpexcel_import($path, $keyed_by_headers = TRUE) {
	if (is_readable($path)) {
		require_once 'sites/all/libraries/PHPExcel/PHPExcel.php';
		// Initiate cache
 $cacheMethod = PHPExcel_CachedObjectStorageFactory::cache_to_phpTemp;
 $cacheSettings = array( 'memoryCacheSize' => '4MB');
 PHPExcel_Settings::setCacheStorageMethod($cacheMethod, $cacheSettings);

fix any issues with reading big xlsx files, author can add it to function phpexcel_import and another

ionmedia’s picture

Status: Active » Reviewed & tested by the community
wadmiraal’s picture

Title: perfomance issue with large xlsx files » Expose PHPExcel caching options
Version: 6.x-2.0 » 7.x-2.x-dev
Category: support » task
Status: Reviewed & tested by the community » Needs work

Hi.

I'm changing the issue.

This is actually a feature I'd like to implement. For now, you can only use the Memcache settings, but that's far too restrictive compared to what PHPExcel has to offer.

I haven't made the move to implement it fully yet, but I'm putting it on my todo list.

Kind regards,

W

wadmiraal’s picture

Status: Needs work » Fixed

Got to spend some time on this and implemented almost all caching options provided by PHPExcel, including Temp, Memcache, APC and memory. It provides a UI to set the caching method and related options at admin/config/system/phpexcel.

It's on dev.

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.

Anonymous’s picture

Issue summary: View changes

errors