Display only one Image in table View (Imagefield+Imagecache+Views)

Well, this is one that hurts my brain for a while now.
If I upload multiple Images for one node, I like to display only one of them in the table view, but all of them in the full node view. With imagefield alone, i get this to work if i "grouped multiple values" in the views option. Since I am using image cache, this doesn't work anymore.
I have looked at both modules (imagefield/imagecache) and i tried it via the views template override functionality - all of them didn't work for me, because in all places i have looked at, i am too late
(the whole html is prepared and there is no (clean) way to drop the unwanted images) or I am to early (sql string is prepared, or just one image is handled).
I would really appreciate it, if anyone can help me or give me a hint to get a solid starting point to
display only one image in a view, but all images on the full node.
Thank you very much.