I haven't looked at the code yet but would it be possible to dynamically size the colorbox for the views field in the case that the only contents of the popup was an image?

Maybe there could be a checkbox where you say the colorbox will only contain a single image?