When adding a block created by a module to a paragraph, it doesn't display

Thanks for an amazing module! Paragraphs is the best thing in Drupal since sliced bread!

I have a block that is created via custom module.
I have a paragraph type that has one field, an entity reference field for "Block". And I can add my block via this field. When I view the page, the block doesn't display. When I go and add the block on the page via Block Layout, then I can see the block that is displayed via Block Layout as well as the block that is added via the paragraph.

What could be the problem that my block isn't showing on the page when I add it via paragraphs unless I also place the block via Block Layout?

Thanks for any help, much appreciated.