[META] [DEMO] BringDrupalAIIntoyourDNA - AI Alt Text Evaluator and Suggestion Agent

Using Flowdrop UI instead of pure FlowDrop -

#3562010: [META] Basic Visual Flow Editor for pure Agents

The below has been added to the meta issue

----

• Figure out if we use Modeller API
• FlowDrop when you click save, it actually saves things to Config itself (So could then be edited like a normal agent).
• Its a bit wierd but there are multiple content forms on one flow.
• We want to use Tool API not function calling (and how easy is it to just add a new tool)
• Flowdrop UI is ONLY for agents now so we need to remove workflow related AI elements (like no deterministic steps).
• Need to put effort into the "Tool" drawer so there aren't loads of unusable ones.
• Need to figure out how to handle the "ChatInput" so we can set up the "Assistant" that is used by the chatbot (Or chatconsumer)
• Some way of saving a flow and coming back to it (Where that is not in config right now?)
• Or can we take an existing Agent flow (like Drupal CMS ones) and the whole thing appears in flowdrop and just loads.
• In this situation flowdrop ui is just a UI, so it doesn't handle any triggers or flows.
• General UX improvements such as exploring what the industry does

Create the Demo Site:

#3562613: Create a Demo Site for the Bring Drupal into your DNA

• Andrew - Create the actual site on Github for the demo - DONE
• Demo Site found here: https://github.com/jamieaa64/BringDrupalAIDNA-NoAgents
• Create the new Flowdrop UI module and FlowDrop AI Module
• Add AI and these new modules to the demo site.
• Upgrade the AI module to the latest
• Add the Theme to the demo site
• Obtain data dump of publicly available content from the EC
• Add the Content to the Demo site.
• Perhaps make it an MCP Server as well so we can show that off and the alt text site can be classified

- We might make a Sandbox module.

Guardrails:

#3562614: Create the Guardrails needed for the No Agents Training Demo

• Make sure Guardrails stuff works from the AI Framework point of view.
• We want some level of abstraction so RAILs, OR amazon or another provider of guardrails can be used.
• We need a nice UX for how an end-user creating the flow pics where the guardrails is done and how its configured.
• There can be advanced configuration for the site admin behind the scenes, but the flow creator shouldn't have to think about things they wouldn't intuitively understand.
• We may have settings on how the flow responds to guardrails. Could be simply stop it, could be retries and then stops it, could be provides the option for user feedback to tweak the response (or approve it anyway), might want to have option to merely report in the moderation page and a human evaluates.
• The goal for this talk is to mention RAILS a bit, and show off the safety that guardrails allows, mention specifically that RAILS allow for sovriegn guardrails and the AI framework allows for multiple sources.

Basic Agent: (Can be done on any site/ locally/ on the github or a sandbox module)

#3561988: Create a simple version of this Agent with Tool and Guardrails

The Below has been added to a meta issue above.

Anmol, prabha

• Create a simple AI Agent flow with Tools API and ANYTHING as a tool. - If we run into problems, build a list of critical issues.
• Create a Tool with the Tool API for editing / viewing the alt text on a media entity (Might be able to make use of existing Tools).
• Then try and add on layers of complexity (Like one agent for viewing and evaluating out of 10, and the second for editing if its too low, and now we have flow with an orchestrator that asks the evaluator first and decides to move on)
• Then see if we can have a PoC version with Guardrails working at all.
• -Then make sure Guardrails is using a proper abstraction layer for multiple providers.

(Checkin Date 15th Dec - When Anmol can get started after a company week away)

Make Simple MCP:

• Create a simple MCP server the text for Alt Rules: https://op.europa.eu/en/web/webguide/alternative-text
• Make use of the MCP Client in Drupal that we have.
• Work on making the UI for the MCP client stuff work nicely with flowdrop UI

Prior to meeting on this some comments:

- We have something that roughly works and so we're almost there!

The Agent itself
- The Evaluator Agent, we need an Assistant for it (Or we can also have it working with Field widget Actions)
- We have an "Entity Moderation Tool" It would be ideal if we could make use of only basic Tools and create an Agent that does this work so it feels more like you can create something with no code.

Other things
- There is work to be done on the UI
- Guardrails
- MCP
- Agent that creates Agents
- Chatbot and Index in the flowdrop UI

Important TODO:

- Fix the Site not building and the problem with the Tools Module + Patches not building even locally
- Another meeting Thursday and Monday

- Set up Slides: Who is doing what?

Jamie: Intro
Prahba - Talk about the evaluation agent itself
David - Something to do with Flowdrop UI
Anmol - Something to do with Guardrails