Show all the filters with content in paged views output

When I page views output or I 'Display a specified number of items', some of the filters will be hidden and when I turn on 'Display all items' then all filters will be showing again.

In addition to this behaviour, when I use views infinite scroll for paging, and I turn on Ajax, the next pages will duplicate the filters, and like said before, any filters without items in the page will be hidden.

I think it will fit better to show all filters with content in the view not minding if any of their items is loaded on the current page.