Active
Project:
Ollama AI
Component:
Code
Priority:
Normal
Category:
Feature request
Assigned:
Unassigned
Reporter:
Created:
22 Feb 2024 at 16:01 UTC
Updated:
8 Jun 2024 at 18:21 UTC
Jump to comment: Most recent
Problem/Motivation
It would be amazing with Ollama support in AI Interpolator:
- It is Open Source, and can be self-hosted
- It is easy to implement
- It is widely useful, and works well as a classical LLM text prompt.
Comments
Comment #2
marcus_johansson commentedAlready is being worked on here: https://www.drupal.org/project/ollama
Comment #3
mindaugasd commentedSince issue belongs within ollama issue queue, I changed the project.
@Orkut Murat Yılmaz integration can reuse some code from Hugging face module https://www.drupal.org/project/huggingface
Module issue: #3420592: Add support in AI Interpolator for Hugging Face
Comment #4
ressaGreat idea, thanks @mindaugasd.
Comment #5
ressaI see that @Marcus Johansson joined the project recently, and that @Orkut Murat Yılmaz made some commits, which is great! Is a release close, or perhaps it can be tested already now?
The
llama3model works well for me in Ollama (run locally in Debian 12) and it would be awesome if Drupal supported at least one self-hosted LLM.Comment #6
mindaugasd commented@ressa
I think this other module supports it already https://www.drupal.org/project/lmstudio . Would you up to test it?
lmstudio is integrated with LLM provider, and module maintainer @seogow is also working on AI interpolator support at the moment.
As per this issue #3426454: Collaboration with existing projects, ollama could also be integrated with LLM provider the same way, and by extension, with AI interpolator.
Comment #7
ressaThanks for the tip about https://www.drupal.org/project/lmstudio @mindaugasd, it looks great!
I guess I should run Ollama with
ollama serveand then use Ollama's IP to connect it to the LM Studio module?And thanks for the link to the issue about collaboration between existing LLM projects, that would be very nice. There are a lot of moving parts to keep track of :)
Comment #8
ressaI tried the LM Studio module, but it's not clear to me how to actually use it -- I can't add a LM Studio block, there are no new LM Studio fields ...
Comment #9
mindaugasd commentedIn case you seek AI interpolator support with lmstudio, @seogow is developing it, but there is non yet. With this patch #3426452: Proposal for Implementing LLM Abstraction in OpenAI Drupal Modules possibly you can get it working with features of OpenAI module.