Problem/Motivation

The current setup allows for a external module to implement the following:

  1. The module wants a specific provider.
  2. The module wants the user to be able actively to choose a provider.

But in a few cases the action and configuration (summarize, categorize etc) is so simple that any model with default configuration will do, and having to setup which model to use for this is just a chore.

We should offer the possibility to set a default provider actively or automatically in the case of one, and add an extra function to the plugin manager that loads the default one for any operation.

Proposed resolution

  • Add a config for default provider per operation.
  • Add a function for loading the default provider for an operation. If none is chosen and multiple are available, throw and error and give back a warning message.

Comments

Marcus_Johansson created an issue. See original summary.

marcus_johansson’s picture

marcus_johansson commented
Status: Active » Fixed

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.

kristen pol’s picture

kristen pol
she/her
Primary language English
Location Santa Cruz, CA, USA
commented
Title: Make default operation providers possible » Make default AI operation providers possible
Component: Code » AI Core module
Assigned: marcus_johansson » Unassigned

We are doing some issue management housekeeping and adding/removing components.

We are removing the "Code" component and want people to categorize issues with the best module/submodule component.

Moving this issue to "AI Core module" as I'm not sure where the best place is.

If we have a new project to move this to, we can optionally do that as a secondary step.

See #3533272: Update AI module project components for more details.