Cache actions support clearing individual panel panes. This is good since you can invalidate only the specific part of the page, and not the other ones. If you're using views content panes, It's recommended to set the cache on the panels level instead of the views level, since this will move the caching up one layer in the logic (The panel doesn't need to be rendered and views does not need to be involved at all).

1. Enable Rules caching on the panel panes in you panel pages and mini panels. You cannot use Time-based caching here.
2. Create a rule with appropriate triggers and conditions
3. Add the action "Clear the cache of panel page panes" or "Clear the cache of mini panel panes".
4. Select the panes to clear.