Active
Project:
Ollama AI
Component:
Code
Priority:
Normal
Category:
Feature request
Assigned:
Unassigned
Reporter:
Created:
6 Nov 2023 at 10:36 UTC
Updated:
22 Jun 2024 at 00:32 UTC
Jump to comment: Most recent
Wouldn't it be nice to have Ollama as a backend option for AI chat user interface
Comments
Comment #2
mindaugasd commentedHi Orkut,
OpenChat looks like an open source models library
Therefor it belongs within your module https://www.drupal.org/project/ollama :)
So I changed issue title, description and moved the issue to ollama issue queue :)
Also referenced similar issues in Augmentor and OpenAI issue queues.
On the other hand, if Augmentor integrates with AIChat, then Ollama does not need to integrate with AIChat.Because, we would have this integration three: OpenChat -> Ollama -> Augmentor -> AIChat.1. OpenChat integrates with Ollama library.2. Ollama integrates with Augmentor.3. Augmentor integrates with AIChat.Maybe that is the way to go?Comment #3
mindaugasd commented-
Comment #4
mindaugasd commentedOllama could have a submodule called "ollama_aichat", which would provide backend for AI Chat user interface.
This is temporary solution, longer term we will figure out better one. For example, ollama could provide plugins for https://www.drupal.org/project/aiwork module instead, but since aiwork is not developed yet, we can have this as temporary solution and will have more elegant solution later in the future.
Comment #5
orkutmuratyilmazThanks for your suggestions, we can do that in this way, I guess.
Comment #6
ressaThanks @Orkut Murat Yılmaz! I just tried the Ollama Docker image as described in Spring AI with Ollama and Meta’s Llama2, and after a few minutes I was presented with a prompt. The description is spot in :)
Would it be possible to have a release of the module, so that we can try it out?
Comment #7
orkutmuratyilmazThis weekend I'll have some more time and I'll publish the first release I guess. We may start planning this feature next week. Thanks for reminding:)
Comment #8
ressaSounds fantastic @Orkut Murat Yılmaz, I look forward to trying it, and will give it a go, as soon as it is available. Have a nice weekend :)
Comment #9
mindaugasd commentedHi,
I just received an issue from person asking for ollama support, so referencing it here: #3442437: Ollama
@Orkut Murat Yılmaz, also have a look at this issue #3426454: Collaboration with existing projects
Making integrations with many different modules can be quite impractical, so it would be great to integrate AI chat user interface with LLM provider only, and this LLM provider would provide all the LLMs including Ollama.
Like this:
Ollama -> LLM provider -> AI Chat user interface.
So Ollama would integrate with LLM provider only, simplifying for you all the integrations as well, because LLM provider could also work with Augmentor and Interpolator, so you also would only need to do 1 integration and reach all the other modules by default.
But we can continue to explore having direct (temporary) integration as well in case we need one, because LLM provider is not ready as of now.
Also recently I released quite big updates for AI chat and AI prompt modules, you can find about changes in the release notes of both modules here:
Comment #10
mindaugasd commentedRelated parent issue #3439441: Rebase on AI module's abstraction layer
When that issue is completed ✅, this issue will be automatically completed as well ✅