CSV node import throwing AJAX 500 error?

Hey I'm getting the same error using xml files so may be more than just a csv formatting issue

An AJAX HTTP error occurred. HTTP Result Code: 500 Debugging information follows. Path: /?q=batch&id=34&op=do StatusText: Internal Server Error ResponseText:

Google Docs would be great however I'm talking about pulling down a few thousand xml files on a daily basis so not really an option.

If you are not using taxonomy with Feed items then this comment is not relevant.

If you are trying to have RSS or XML (etc.) "Feed Item" nodes inherit a taxonomy term from the parent "Feed" importer node and seeing "An AJAX HTTP error occurred. HTTP Result Code: 500 Debugging information follows." :-

Multiple Feed project issues have been created for this, or with similar message but the relvant one appears to be:-
"taxonomy_node_get_terms doesn't work with drupal 7"
http://drupal.org/node/959984

Google docs does not solve my problem. I am able to upload some csv documents without problem, but for others, it throws this error. Seems to be an intermittent problem.

Never mind...still not working...

Highly recommend not using feeds for this, and doing something custom. At my job we process 100,000+ xml files into drupal and feeds can not to that.

I don't think not using feeds is a solution to this problem.
Perhaps upping the PHP memory limit is a solution? Just a thought.

I had the same error message. The patch at http://drupal.org/files/feeds-unsupported_opperand_types-1213472-28.patch fixed the problem for me. Or see comment #28 at http://drupal.org/node/1213472.

I believe this has something to do with bad characters in the csv.

I created a CSV file with entries with crazy characters and it fails immediately.

Then I imported some files with no bad characters and it works fine.

Then I tried to do a file with both, and I got 28% of the way though before it failed.

Here's some text samples from my 100% fail file.

C/ Álvaro Cunqueiro, 2 - entrepl, A Coruña, Spain
C/ Valdoreix, 56 - 1º - 09172 Sant Cugat del Valles , Barcelona , Barcelona, Spain
C/ Claudi Guell, 4 - 1º - 2ª, Santa Coloma de Cervelló , Barcelona - 08690, Spain

{"results":[{"formatted_address":"A Coruña, Spain","types":["locality","political"],"address_components":[{"types":["locality","political"],"short_name":"A Coruña","long_name":"A Coruña"},{"types":["political"],"short_name":"A Coruña","long_name":"A Coruña"},{"types":["administrative_area_level_2","political"],"short_name":"C","long_name":"A Coruña"},{"types":["administrative_area_level_1","political"],"short_name":"GA","long_name":"Galicia"},{"types":["country","political"],"short_name":"ES","long_name":"Spain"}],"geometry":{"viewport":{"southwest":{"lat":43.337341,"lng":-8.4382592},"northeast":{"lat":43.3864073,"lng":-8.3871082}},"location":{"lat":43.3623436,"lng":-8.4115401},"location_type":"APPROXIMATE","bounds":{"southwest":{"lat":43.337341,"lng":-8.4382592},"northeast":{"lat":43.3864073,"lng":-8.3871082}}}}]}

{"results":[{"formatted_address":"Carrer Molí de Valldoreix, 56, 08197 Sant Cugat del Vallès, Barcelona, Spain","types":["street_address"],"address_components":[{"types":["street_number"],"short_name":"56","long_name":"56"},{"types":["route"],"short_name":"Carrer Molí de Valldoreix","long_name":"Carrer Molí de Valldoreix"},{"types":["locality","political"],"short_name":"Sant Cugat del Vallès","long_name":"Sant Cugat del Vallès"},{"types":["administrative_area_level_2","political"],"short_name":"B","long_name":"Barcelona"},{"types":["administrative_area_level_1","political"],"short_name":"CT","long_name":"Catalonia"},{"types":["country","political"],"short_name":"ES","long_name":"Spain"},{"types":["postal_code"],"short_name":"08197","long_name":"08197"}],"geometry":{"viewport":{"southwest":{"lat":41.4551018197085,"lng":2.0691524697085},"northeast":{"lat":41.4577997802915,"lng":2.0718504302915}},"location":{"lat":41.4564499,"lng":2.0704923},"location_type":"RANGE_INTERPOLATED","bounds":{"southwest":{"lat":41.4564499,"lng":2.0704923},"northeast":{"lat":41.4564517,"lng":2.0705106}}},"partial_match":true}]}

{"results":[{"formatted_address":"Carrer Claudi Güell, 4, 08690 La Colònia Güell, Barcelona, Spain","types":["street_address"],"address_components":[{"types":["street_number"],"short_name":"4","long_name":"4"},{"types":["route"],"short_name":"Carrer Claudi Güell","long_name":"Carrer Claudi Güell"},{"types":["locality","political"],"short_name":"La Colònia Güell","long_name":"La Colònia Güell"},{"types":["administrative_area_level_2","political"],"short_name":"B","long_name":"Barcelona"},{"types":["administrative_area_level_1","political"],"short_name":"CT","long_name":"Catalonia"},{"types":["country","political"],"short_name":"ES","long_name":"Spain"},{"types":["postal_code"],"short_name":"08690","long_name":"08690"}],"geometry":{"viewport":{"southwest":{"lat":41.3611724197085,"lng":2.0262381197085},"northeast":{"lat":41.3638703802915,"lng":2.0289360802915}},"location":{"lat":41.3625214,"lng":2.0275871},"location_type":"ROOFTOP"},"partial_match":true}]}

I seem to be able to get passed the 'Cannot acquire lock for source node / 0.' by dealing with these 3 items.

Additionally, if you have mega files like me:
PHP max_execution time will eventually kill the batch process main thread.

Additionally, if you're running fastcgi like me:
FPM's request_terminate_timeout will eventually kill the batch process main thread.

Additionally, if you're like me and running into timeouts:
The acquire_lock in {semaphore} will remain until it times out and you'll need to DELETE it from the {semaphore} table before restarting the batch.

Best way to import would be through CGI and Drush. I don't believe feeds provides anything currently to handle this...but I did find this sandbox, but have yet to test it out.
http://drupal.org/sandbox/enzo/1865202

Hi,

Also error 500 on xml with 130000 lines...how can I get this imported with feeds without having to cut the xml into 10 pieces of xml?
Background option is not working, then also crash of site.
Greetings,
Martijn

same problem here when i upload the csv file, but there is only 500+ rows in my csv file. maybe is bad chinese characters i guess...... any ideas ?

So characters such as ñ are causing feeds to spit an error? Mine was freezing at 40%, I'm trying to figure out what character in my file is causing this issue.

I found a fix (not really!, but). Unlocking the importer showed me that 30% items were imported, then I re-imported the same file, it went to 30 % in less than a second then stuck at 56%. I was able to import in 3-4 tries. I know this isn't the right way but got no choice right now. Can php_upload limit be the culprit ? because by default, it allows uploads of only 2mb and my file size is 5mb

I would recommend using a drush script to import. I posted enzo's sandbox in #19. I've patched it for my needs. I believe I posted those patches in his sandbox. There's also a feeds variable which needs to get updated, which limits an import to a certain amount of items, if you're using that script.

I believe anyone who's doing this via the web is running into PHP execution time problems, or memory limit problems or what every else type problems, which can be avoided by using the CLI via drush (providing your CLI has high values).

I imported a couple thousand items 2-3 days ago with out issue using that script. My CSV for that import had many UTF-8 strange chracters, and as long as you're making sure your encoding is ok, you will not have problems.

I've .tgz'd up enzo's sandbox with my patches for ease of use. I also wrote a small README.txt in the folder for those who are interested. I know there's other drush feed importers, but I've been using this one for about a year and it works fine for my needs.

See #2866431: 500 Internal Server Error or #1219296: Partial import then ajax message - 500 error.