via the entity property info API we have knowledge about entity relationships (independently from any schema). Let's expose this as a CTools relationships also?
We should make sure we do not duplicate any existing ctools relationships though. Not sure whether we can do this with CTools' API? Worst case, we could still make it opt-in only by only providing this if a special flag is set in the entity references' property info.