Language "Not applicable" not supported

When you programmatically create a paragraph with language "Not applicable" the entity edit form throws following error:

InvalidArgumentException: The entity cannot be translated since it is language neutral (zxx)

This seems to happen because paragraphs assumes entities are always language-specific and automatically creates new translations:

if ($paragraphs_entity->hasField('content_translation_source')) {
  // Initialise the translation with source language values.
  $paragraphs_entity->addTranslation($langcode, $paragraphs_entity->toArray());
  // ...
}