Allow building pages with AI using attachments [#3534134]

--- AI TRACKER METADATA ---
Update Summary: Allow building pages with AI using attachments
Check-in Date: MM/DD/YYYY (US format) [When we should see progress/get an update]
Due Date: MM/DD/YYYY (US format) [When the issue should be fully completed]
Blocked by: [#XXXXXX] (New issues on new lines)
Additional Collaborators: @username1, @username2
AI Tracker found here: https://www.drupalstarforge.ai/
--- END METADATA ---

Overview

As a content creator, I want to create content in the tool of choice and then easily migrate that to Experience Builder. We should first focus on documents that are used for a single page, e.g. .pdf , .doc,.docx, .md, an .txt. In future we should expand to being able to create multiple pages by uploading files that may contain multiple entries, such as .csv.

Proposed resolution

We should start by researching which of these file types can be processed by common LLMs such as OpenAI and Anthropic.

User interface changes

Comments

Comment #1

4 July 2025 at 08:50

lauriii created an issue. See original summary.

Comment #2

lauriii

he/him

Finnish

Finland

commented 4 July 2025 at 08:51

Parent issue:

#3517831: [META] XB AI Capabilities

» #3530701: [META] XB AI Issue List

Comment #3

yautja_cetanu commented 15 July 2025 at 13:20

Before doing this we need to decide:

What service are we using to help AI understand attachments? (Unstructured.io for example?)
Or are we using a service that takes a file and generates a screenshot and then passes that?
Once we have decided we will want a new operation type and abstraction layer to make it so different services can be used and make sure it degrades gracefully if these services are not available.
Text and md files probably need to be handled differently as can be passed directly to the LLMs
Want to check what the priorities are for this compared to Figma to Drupal and Images being uploaded?
(Do the files go straight into the prompt? Or is there some way of sending files to the API