Using v4-shim with Partial file configuration still load all.min.js

Problem/Motivation

When using shim, the all.min.js is always loaded even if we unchecked some styles.
Based on the fontawesome doc this is not needed:

https://fontawesome.com/v5/docs/web/use-with/wordpress/install-manually#...

You should use the same version for the shims as you use for the main assets (such as either all.js, or some combination of fontawesome.js and styles like duotone.js, as shown above).

Steps to reproduce

In BO:

• Choose only duotone in Partial file configuration
• Check "Use version 4 shim file?"

In front, all.min.js is loaded when it is not needed:

Proposed resolution

remove dependency from the shim libraries to the all libraries

Remaining tasks

Dependencies can be handled dynamically in the hook_library_info_alter()
I don't think that this is worth it but if someone has more time to handle it, it would be cleaner.