Language domain setting is ignored when generating language-specific sitemaps

We have a multi language site which uses the domain access module to restrict content to specific domains. In addition we use the domain name to switch between languages.

Each sitemap shows the right paths when accessed from one of the language domains but it always has the main domain name (which is bad for us as these will generate 404s as per our setting).