Filter Floppy by Node Relationship?

I've made a set of image galleries, based on the technique you developed for Views Gallery in D6, but I've updated it to work pretty much the same in D7.

The Galleries of Image nodes are broken into painting categories like Landscape, Portrait, and Still life, based on the Node reference to the Gallery Node for each category (there's a content type for gallery and for gallery image).

So what I would like to do is use floppy to display the previous/next links to the images within the categories as defined by the node reference. Right now, it shows the previous/next based on the Gallery Image content type, but the criteria is the date the image node was added. So the next image may skip from Landscape, to Portrait, and back to Landscape--depending on the order in which I loaded them.

Will there be any way to filter (and hopefully order) the links based on something like that Node Reference?