Support for Drupal 7 is ending on 5 January 2025—it’s time to migrate to Drupal 10! Learn about the many benefits of Drupal 10 and find migration tools in our resource center.
By BramDriesen on
Change record status:
Published (View all published change records)
Project:
Introduced in branch:
9.5.x
Introduced in version:
9.5.0
Issue links:
Description:
Drupal's default robots.txt file (used for informing web crawlers what paths to not index) has been updated to disallow indexing of Oembed media links. This change only added following rules.
...
Disallow: /media/oembed
Disallow: /*/media/oembed
...
Disallow: /index.php/media/oembed
Disallow: /index.php/*/media/oembed
...
File changes:
- core/assets/scaffold/files/robots.txt
- robots.txt
Impacts:
Site builders, administrators, editors