LLM Provider Service

DEPRECATED - This module has been deprecated and all its functionality was ported into AI module.

Efforts are currently underway to integrate AI (specifically Large Language Models, or LLMs) into the Drupal ecosystem, as evidenced by initiatives such as the OpenAI / ChatGPT Integration. However, there is a notable absence of an LLM abstraction layer that would allow users to leverage the existing functionality across various LLMs seamlessly.

Features

This module is designed for developers, aiming to provide a unified interface for accessing LLMs within Drupal. It introduces an LLM Provider Interface, registers enabled LLM services, and offers a composite service encompassing all enabled LLMs along with their listings.

Post-Installation

Upon the availability of any compatible LLM Provider, the LLM Chat Example submodule enables simple chat interactions with the accessible LLMs. Users can freely select from the enabled LLMs.

Additional Requirements

It is important to note that this module itself does not provide access to any LLM; it serves as an interface for developers. To incorporate LLM functionality into your site, you must enable and configure at least one LLM Provider:

• Drupal LLM Provider for the LM Studio API.
• Huggingface.

Similar projects

This module draws inspiration from two LLM modules that utilize ChatGPT (OpenAI), specifically the OpenAI / ChatGPT Integration and ChatGPT Content Assistant. However, these projects currently lack an abstraction layer for the utilization of other models.