Creating a gallery with views.

I've been banging my head against a wall with something I thought would be pretty simple. I am using Views along with CCK and Taxonomy to create a few image galleries. I set it to display 16 items per page in a 4x4 grid. I am using imagecache for the thumbnails and Lightbox2 for displaying the images. The problem I am having is that the images are a mess on the page, and it is displaying way more than 16 of them.

Here is a pic of my view setup, and here is how the gallery comes out.

I feel like I must be missing something simple. Thanks in advance!