DEPRECATED - This module has been deprecated and all its functionality was ported into AI module.

This module serves as an LLM Provider for LM Studio, a platform that facilitates the local downloading and running of Large Language Models (LLMs) while ensuring seamless integration with Hugging Face. LM Studio provides an out-of-the-box API that this Drupal module can interact with. As a result, you can now easily test any LLM compatible with LM Studio directly within your Drupal site, before committing to developing a custom API.

Features

This module utilizes the LM Studio API to act as an LLM Provider for the LLM Provider Service module in Drupal. It enables immediate use of the LLM Chat Example submodule within the LLM Provider Service, allowing for real-time interaction with your LLM model directly from the Drupal interface.

Post-Installation

After configuring the URL and port for your LM Studio instance in the Drupal admin settings (/admin/config/system/lmstudio-settings) you can enable the LLM Chat Example within the LLM Provider Service. This setup facilitates direct communication with your LLM from Drupal, showcasing a practical example of integrating LLM functionality into your site.

Additional Requirements

For the module to function, the API feature must be enabled within LM Studio.

Supporting organizations: 

Project information

Releases