WHEN WE TRY TO IMPORT A FILE 900MB XML, WHY HAVE OVER 200,000 PRODUCTS FOR AN ONLINE STORE, GIVES SERVER PROBLEMS, WHICH WOULD BE THE OPTIMAL SETTINGS FOR IMPORT FILES SO BIG?

THANKS SO MUCH.

ERROR:
Memory allocation failed : growing buffer on line 0. Error code: 2 There was an error parsing the XML document.

Comments

j4rk0r’s picture

j4rk0r CreditAttribution: j4rk0r commented

Memory allocation failed : growing buffer on line 0. Error code: 2 There was an error parsing the XML document.

j4rk0r’s picture

j4rk0r CreditAttribution: j4rk0r commented
Issue summary: View changes
ethanLee’s picture

ethanLee CreditAttribution: ethanLee commented

you can try to separate them into different files, like 30000 product each??. 200000 products need many memory resource......

twistor’s picture

twistor CreditAttribution: twistor commented
Project: Feeds » Feeds XPath Parser
Version: 7.x-2.0-alpha1 » 7.x-1.x-dev
Component: Feeds Import (feature) » Code
Assigned: j4rk0r » Unassigned
Priority: Critical » Normal
Issue tags: -big files in XML

Are you using Feeds XPath Parser?

If so, then there's nothing you can really do unless you split up the XML into multiple files.

Another thing you could do is write a custom parser that uses a different XML parser that doesn't try to read the whole file at once.

900MB is a very, very large XML file. Trying to read it all at once is not feasible.