Pager appears when 'View All' exposed filter is on and AJAX is off

I'm encountering an issue with all versions of Views 3 including rc2 :

I have a list of items (in my case taxonomy terms) set to 9 per page (21 items).
I've checked 'Include all items option' within the View's Pager options.
AJAX is off.
When the 'view all' option is applied the pager still remains on the screen.
When AJAX is on, the pager is correctly removed.

Is anyone else encountering this bug?