Problem/Motivation

AWS has started forcing using inference profiles for certain models in the system, like Anthropic. This renders them unusable for this provider because the model IDs can't be called directly like normal on-demand models and they're not provisioned models.

Proposed resolution

The model's inference support is returned in the initial model call, so the easiest solution would be to look for that and adjust the model IDs to use the inference profile names which can be either 'us' or 'global' depending on where the user is calling the models from.

Command icon Show commands

Start within a Git clone of the project using the version control instructions.

Or, if you do not have SSH keys set up on git.drupalcode.org:

Comments

jacobbell84 created an issue.

jacobbell84 changed the visibility of the branch 3586773-inference-profiles-arent to hidden.

jacobbell84 changed the visibility of the branch 3586773-inference-profiles-arent to active.

ishani patel made their first commit to this issue’s fork.

ishani patel’s picture

Hello,
I've resolved the PHPCS error and updated the MR.

Thank you!