Admin theme not loading when memcache is active

I have memcache set up with two servers: Config looks like this.

$settings['cache']['default'] = 'cache.backend.memcache';
$settings['cache']['bins']['config'] = 'cache.backend.database';
$settings['memcache']['servers'] = [
  'x.x.x.x:11211' => 'default', // PRD 01
  'x.x.x.x:11211' => 'default' // PRD 02
];

After some period of time and a few cache clears, you cannot visit any admin pages and you receive these errors in the log.

Uncaught PHP Exception Twig_Error_Loader: "Template ".html.twig" is not defined (Drupal\\Core\\Template\\Loader\\ThemeRegistryLoader: Unable to find template .html.twig in the Drupal theme registry. at /core/themes/seven/templates/page.html.twig line 44

The code there is:

{{ page.header }}

I think there is something to do with there being more than one memcache server.

I don't see this error locally where memcache is not installed.
I do not see this on dev where there is one memcache server.
I do not see this on production when disabling memcache.