Currently you have to sideload the models via the Ollama cli command, it would be nice to add this to the settings page or its own page so you can do it via Drupal, since there is an API for it.
Add a page where you can load or remove models for Ollama.
A new form added under /admin/config/ai/providers/ollama/models which appears also as local task under /admin/config/ai/providers/ollama
Show commandsStart within a Git clone of the project using the version control instructions.
Or, if you do not have SSH keys set up on git.drupalcode.org:
changes, plain diff MR !15changes, plain diff MR !9
Comments
Comment #2
marcus_johansson commentedDocumentation for the API here: https://github.com/ollama/ollama/blob/main/docs/api.md
Comment #3
mjb3141 commentedComment #6
efpapado commentedA first approach, trying to combine the ollama's streamed response while pulling with Drupal's Batch API.
Comment #7
efpapado commentedSorry, accidentally removed mjb3141 from assignment, but cannot add back :/
Comment #8
efpapado commentedUpdated issue description.
Comment #9
marcus_johansson commentedI switched over to 1.2.x, but this needs a rebase and some code fixes before being ready to be merged.
Comment #12
efpapado commentedMR against 1.2.x, with code fixes.
Comment #13
jibranThe MR looks good. Let's add some functional test for the new functionality.