Dunno if this is overlay or Openlayers's issue.
Steps to reproduce:
- Enable core's overlay module
- Add a link to 'admin/structure' inside an popup
- When clicking on link, link target replaces page, instead of opening in Overlay as expected.
I'd be happy to bugtrack this more, but unsure where to start looking.