Provide a notification message dismiss feature

Problem/Motivation

It's common that users may want to dismiss notification messages so they're not shown multiple times. It would be great to have support for this feature out of the box.