Problem/Motivation

There have been grumblings that AGENTS.md "wasn't doing anything", with slop issues and comments still coming through. So over in #3636154: Remove CLAUDE.md now that Claude (finally) supports AGENTS.md I thought it would be pretty funny to solve this with Claude Code, and decided to attempt to do this with my normal "vibe coding" flow (e.g. just ask the agent to fix it, not read anything in advance, lean on the agent's built-in knowledge + default skills) and then log what happened.

The log and the follow-up tests showed:

  • core/AGENTS.md does not load when an agent starts at the repository root, which is where its own commands run from.
  • It ships to every site through drupal/core, with rules meant for core contributors.
  • The code checks and tests were never run, and nothing reported that.
  • No rule required the operator to see a post before it went up.
  • The agent first saw the AI policy at step 73 of 75.

How this scope was reached

The first version of this issue proposed a lot more, including replacing the "Discouraged uses" section and changing the disclosure line. Reading #3585894: LLM harm reduction in Drupal core contribution, AGENTS.md guidelines changed that. That file came after several earlier issues, and it is a harm reduction compromise that went in for a three-month trial.

  • "Discouraged uses" is layered on purpose (#15), and it was part of what the release managers agreed to (#41). It stays.
  • The disclosure line names no tool on purpose, because small local models hallucinate their names (#11). It stays.

What is left is what serves the file's own goal: rules that reach core contributors, checks that actually run, and a human seeing each post first. The trial started on 2026-06-27, and its evaluation in #3606814: [PP until 2026-09-30] Evaluate AGENTS.md effects has not happened yet.

Proposed resolution

  • Move AGENTS.md and CLAUDE.md to the root. This keeps them out of drupal/core.
  • Add check and test setup to §3 and §4.
  • Add §6: approval before posting, no self-RTBC, no credit changes, no pushing to another contributor's MR without their agreement.
  • Add §7: read issues through the API, not a summary, and the issue fork steps.
  • Link the AI policy.

Tested with Claude Code and Codex against a fake posting command. Without §6, agents posted in 8 of 8 runs. With it, 0 of 8. Full steps and results are in the attached process log, and the raw output of every run is in the second attachment.

Remaining tasks

  • Release and framework manager review, with #3606814.

What this does not fix

This will not end the original complaint. Anyone pasting from a chat window never loads this file, and it cannot prove that an operator understood the output.

  • Started outside the checkout, Claude Code loads the rules only after opening a file there. Codex did not load them.
  • Started in core/, headless Claude Code skips the import.
  • Approval given in advance bypasses §6.
  • drupal/drupal still includes root files.
  • cspell does not cover the root file.

Release notes snippet

Rules for LLM tools used on Drupal core moved from core/ to the repository root, so they apply when a tool is started at the root of a clone and no longer ship to site projects. New rules require operator approval before posting to drupal.org, forbid pushing to another contributor's MR without agreement, and require reporting which tests did not run.

AI disclosure

Generated with the help of an LLM.

Issue fork drupal-3636156

Command icon Show commands

Start within a Git clone of the project using the version control instructions.

Or, if you do not have SSH keys set up on git.drupalcode.org:

Comments

webchick created an issue. See original summary.

webchick’s picture

Issue summary: View changes

Another one from some back and forth questioning.

webchick’s picture

Issue summary: View changes
webchick’s picture

Issue summary: View changes
webchick’s picture

Title: Rework core/AGENTS.md: add contribution workflow, fix location, align with AI policy » Rework core/AGENTS.md: move to repo root, add contribution workflow, align with AI policy
Issue summary: View changes
Issue tags: +#AX (Agent Experience)
webchick’s picture

Issue summary: View changes

Fixing some copy/pasta mess.

webchick’s picture

Issue summary: View changes
webchick’s picture

Priority: Normal » Major

Since what's there currently is working for neither harm reduction nor agentic developer workflows, and since there's a narrow window of time to fix this before it becomes a wider-spread problem, let's escalate. :P

webchick’s picture

Title: Rework core/AGENTS.md: move to repo root, add contribution workflow, align with AI policy » Move AGENTS.md to the repository root, make its checks runnable, and link the AI policy
Issue summary: View changes
Status: Active » Needs review
StatusFileSize
new17.31 KB
new199.54 KB
webchick’s picture

Issue summary: View changes
webchick’s picture

Issue summary: View changes
StatusFileSize
new20.35 KB
new245.5 KB
webchick’s picture

Heh, that was fun. :P

Ok, this should be *actually* ready for review now. Claude and I went back and forth for the better part of 3-4 hours, doing before/after test runs on both it and Codex (until I ran out of credit :D) to justify these skill wording changes. The intention of this one is to generate fixes inline with the original issue and core maintainers' wishes which were proven to not be respected in #3636154: Remove CLAUDE.md now that Claude (finally) supports AGENTS.md.

webchick’s picture

Issue summary: View changes
cainaru’s picture