
Problem/Motivation
Jan.ai is much like LLM Studio but with a greater privacy focus.
https://jan.ai/
https://github.com/janhq/jan
Can Jan.ai be a provider for the AI module?
Jan.ai is much like LLM Studio but with a greater privacy focus.
https://jan.ai/
https://github.com/janhq/jan
Can Jan.ai be a provider for the AI module?
Comments
Comment #2
socialnicheguru commentedComment #3
socialnicheguru commentedComment #4
marcus_johansson commentedIt will not be in the AI core module, because we will be moving out all providers from core into contrib modules now :)
However if you want to either find people to do this or support it or want to support it yourself, I have no problems doing the initial development for you. I can however not support it, I have to many projects to support already. So, if I am to build it I need to know that there are at least two maintainers ready to take any support requests and bug requests coming in.
One place to look for other people to help you out are on the channels #ai and #ai-provider-maintainers.
Since it will not be a feature of the AI module, I'll switch this to a support request so we can see if someone else is looking for this provider and ready to help.
Comment #5
socialnicheguru commentedPoint me in the direction. what woudl it look like. should I look at the LLM Studio provider and make modifications based on the Jan.ai api?
Comment #6
marcus_johansson commentedWithout knowing jan.ai, LMStudio I think is the closest one. As long as its OpenAI compatible, which it looks like, it should be fairly easy and mostly copy and paste (see https://jan.ai/docs/remote-models/generic-openai).
You would need some way of either getting the models, I couldn't find anything on a quick google. If that is not available, the user has to fill in the models themselves, there is a generic way of doing this, you can see in Huggingface provider (or Azure provider).
Comment #7
marcus_johansson commentedThere is this documentation now, if it helps you out: https://project.pages.drupalcode.org/ai/developers/writing_an_ai_provider/
Can I close this, since it will not be in the AI module, but should be created as an external module?
Comment #8
socialnicheguru commentedComment #9
kristen polWe are doing some issue management housekeeping and adding/removing components.
The "Providers" component will be removed because providers have been moved into their own projects, so this issue is being moved to "Miscellaneous".
See #3533272: Update AI module project components for more details.