Active
Project:
AI Ongoing Evaluations
Version:
1.0.x-dev
Component:
Code
Priority:
Major
Category:
Plan
Assigned:
Unassigned
Reporter:
Created:
12 Nov 2024 at 15:02 UTC
Updated:
27 Nov 2024 at 11:13 UTC
Jump to comment: Most recent
The goal of the evaluations module is to be an overall framework to allow people to produce evaluations quickly and easily. However the immediate need is to evaluate the AI functionality in Drupal CMS. This module won't go in Drupal CMS so we can be really relaxed about the initial alpha/ pre-alpha as its just to be used for a small number of early test sites and we can then build it out into something that will work in more general use-cases.
This is part of the AI ecosystem but won't be in the module as may not want it on a live site (Although it will handle ongoing evaluations so may move into the AI module at some point)
Comments
Comment #2
yautja_cetanu commentedPossibly in addition to this.
- Have a simple export that just says "Thumbs up / thumbs down" (Maybe which agents its done) that can be integrated with telemetry. Can monitor in aggregate if its going well.
Comment #3
ronaldtebrake commented+1 on this, think this will be great to have a also to provide as proof of how valuable the end users are finding this