Install
Works with Drupal: ^10.5 || ^11.2Using Composer to manage Drupal site dependencies
Alternative installation files
Download tar.gz
18.24 KB
MD5: 165d1e704f886764c147a6b875aad107
SHA-1: 17008652147e89d3830f760520c17758483a9375
SHA-256: dab191d8038ec69b8aa927d24c20d46401a8841b6e159d268c2b487a761c6923
Download zip
26.75 KB
MD5: ab3c50ebd9e0216689da5b75c50023e2
SHA-1: 569195255a6043ff13d19f0fc453aafe32458f7c
SHA-256: ee9a8f514eda65c0f7e8ec5ecf14e8e8ffc0e08d41f004391f267c047378228d
Release notes
First alpha of the NVIDIA provider for the AI module. It adds NVIDIA NIM and self-hosted NIM microservices as a provider, verified against the hosted API for chat, tool calling, structured JSON output, image input and embeddings.
What is included
- Chat with streaming, tool and function calling and structured JSON output, through the AI module's OpenAI-compatible client.
- Embeddings with NVIDIA's query and passage input types.
- Per-model capabilities: the provider decides from the model id whether a model is offered for tools, JSON, structured output or image input, and follows whatever you save on the AI module's model settings form.
- Readable errors: NVIDIA's RFC 7807 style failures are translated into normal AI module exceptions.
- Configurable host for self-hosted NIM deployments.
Requirements
- AI module 1.5 or later
- Key module
Known limitations
- The model list is NVIDIA's whole public catalogue; models your account is not entitled to fail with "Not found for account".
- Capability detection is name based. Correct a wrong guess per model on the AI settings model form.
- Moderation, image and audio generation are not supported.
Alpha means the API may still change and some rough edges remain. Please report problems in the issue queue.