When I'm running the recommendation engine with a large dataset (numbers below) I'm getting an error that Java has run out of memory. The error is: Target Exception: java.lang.OutOfMemoryError: Java heap space

I've also attached the full log from the command prompt.

This is running on a brand new Drupal 6 install, the only tables that have been populated are for the recommender. I CAN successfully run for smaller batches, so this seems to be related to the number of records it's trying to parse?

Is this something with the code not cleaning up memory, or is this just too much data? This computer is used just for recommendations and I'm happy to change whatever settings necessary to get it running. It has 12G of memory installed.

Table Stats:
Rows: 2,021,146
Distinct Users: 69,853
Distinct Nodes: 38,244

I'm happy to send/attach any ini or config files that might be helpful. Dan, I think you have my contact info already. -Connor

Out of Memory Error.txt3.34 KBangusmccloud


danithaca’s picture

Status:Active» Closed (works as designed)

Perhaps you need to change run.bat and use "java -Xms1024M -Xmx4192M ...". Please look at the -Xms and -Xmx parameters which give java more memory. They are something like the php_max_memory parameter.

If this still doesn't fix the problem, please reopen the issue again.

danithaca’s picture

Issue summary:View changes

Added additional details at bottom