When no search results all nodes are displayed in map when using ajax in views

I created a basic locator with a proximity search function, using Geofield in Views. In order to display no results by default when a visitor lands on a page, I set the Exposed form style to "Input required" instead of "Basic", which does the job.

When I set Use AJAX to "Yes" in the View, it would show all the results after the first search query. It should be displaying the proper results or no results on the map when there are none ofcourse.

If I switch off "Use AJAX" everything works as it should. So it must be something specific with the AJAX setting.