s3fs 8.x-3.0-beta2

Beta2 Bugfix release

This release fixes a significant bug in beta1 where upload_as_private was not being honored causing the release to break on buckets that have BlockPublicACL enabled.

Contributors (3)

cmlara, yijiang, Darvanen

Changelog

Issues: 1 issues resolved.

Changes since 8.x-3.0-beta1:

Bug

• #3223654 by cmlara, yijiang, Darvanen: upload_as_private not respected for validate(), S3fsFileService, and S3fsFileMigrationBatch

Beta1 release notes (reposted)

First beta release

This release contains bufixes and features.

Any remaining open bug reports are regarding limitations in Drupal Core, limitations of the SDK, or are caused by other modules.

This release is believed to be stable and ready for final testing prior to a formal stable release.

Significant Changes

• #3204635 The S3fsFileSystem service now calls the AWS S3 API reducing the number of times the AWS S3 StreamWrapper creates tempfiles of content already on disk or in S3.
• #3201248: Realtime lookups to S3 for files not in cache are no longer performed.

gagsfitz@gmail.com, Manuel Garcia, cmlara, malcolm_p, jacobbell84, Darvanen, douggreen, Simon Peacock, voleger, adding , davidlfg, tostinni, muaz91, csmdgl, larisse, RobertoGuzman, natemow, daggerhart, bobbygryzynger, vidorado, azinck, jonathanshaw, scott_euser, James Byng, kapil17, sebas5384, mikeryan, eddie_c, josephgut, coredumperror, aguilarm, jordan8037310, stevenlafl, Grimreaper, crstnkal, ShaunLaws, osopolar, gustavderdrache, zach.bimson, J2, Sylve, oheller, tbadaczewski, DaKaZ, mirhamzah, Anas_maw, heddn, pratik.mehta19, mjgruta, afeijo, aangel, Jesmaster

Changelog

Issues: 57 issues resolved.

Changes since 8.x-3.0-alpha17:

Bug

• #3222276: Unable to upload public:// files
• #3204635 by cmlara: Fix typehint error in D8.9/9.0 caused by adding #3204635.
• #3134530 by davidlfg, cmlara: cURL error (60) SSL certificate problem: self signed certificate
• #3219822: Rename hook_s3fs_rename_params_alter to hook_s3fs_copy_params_alter
• #3219622: Harden hash checking in S3fsImageStyleDownloadController
• #3219242 by cmlara: MimeTypeGuesser::guess() is deprecated in drupal:9.1.0 and is removed from drupal:10.0.0. Use ::guessMimeType() instead
• #3219446: ExpireTime incorrectly overridden for Response* headers (SaveAs handling)
• #3219227: Cleanup higher risk phpcs Drupal Standard coding messages
• #3218819 by cmlara: S3fsFileMigrationBatch should set ContentType
• #3213867 by cmlara, tostinni: S3 SignatureDoesNotMatch error when using presigned URLs due to itok image token
• #3208175: drush s3fs:copy-local --scheme=all stalls at private://
• #3208759 by gagsfitz@gmail.com, cmlara: Validation fails when config is read only
• #3212468 by csmdgl, larisse, RobertoGuzman: Warning: Trying to access array offset on value of type bool in Drupal\s3fs\StreamWrapper\S3fsStream->getS3fsObject()
• #3217724: Port not honored when generating presigned links using custom S3 host
• #3217538: PHP 8.0 RefreshCacheBatch Error: Cannot use positional argument after named argument
• #3214168: localstack not ready causes test failures
• #3013779 by natemow: IMCE File Browser Compatibility - Port to 8.x-3.x
• #3213512: Fix non API/low risk code sniffs
• #3211484: Edge cases responses break refresh-cache
• #3211523 by bobbygryzynger: HTTP middleware implementations can result in the Request object being null in S3fsStream.php
• #3007043 by vidorado, cmlara: Image styles not generated due to page cache
• #3203137 by azinck, cmlara: Allow paths to be used with custom CNAME functionality
• #3208072 Tests for Drush
• #3209291: Updated file migration fails to honor root_folder
• #3204634: Document 5GB limit to saving files.
• #3208183: Version database field may be too small
• #3202909 by cmlara: File migration does not update database entries from s3://prefix
• #3205964 by jonathanshaw, cmlara: S3fsService:writeFolders is not compatbile with interface
• #3004034 by James Byng, cmlara: When editing an image style I get Subfolder is not empty in Aws\S3\StreamWrapper->triggerError()
• #2823409 by kapil17, sebas5384, cmlara, mikeryan, eddie_c, josephgut, coredumperror, aguilarm, jordan8037310: S3FS Ignores its database limit on URI length
• #3200867 by cmlara: Move/Rename 'directory' fails
• #2986407 by stevenlafl: s3fs-refresh-cache is not scalable
• #3154241 by scott_euser, cmlara: 504 timeout on very large S3 buckets, make refresh cache action use batch process
• #3203357: Cache Refresh Maximum execution time exceeded in Drupal::service()
• #2927864 by Grimreaper, cmlara, crstnkal: Can't access private files when using s3 as the private stream wrapper
• #3090600 by cmlara, scott_euser, Sylve, oheller, tbadaczewski, DaKaZ: S3 File System drush s3fs-copy-local and also copy local public file to s3 in Admin Config form in action tab not working
• #2978330 by mirhamzah, Anas_maw, cmlara: Uncaught Exceptions
• #3201395 by cmlara, heddn: #2948554 no upgrade path (remove config)
• #3137912 by davidlfg, cmlara: URLs of private files contain a language prefix
• #3199125 by pratik.mehta19, cmlara: Encryption setting not passed to PutObject during config validation tests
• #3023558 by mjgruta, afeijo, aangel: Error executing "PutObject"
• #3201250 by Jesmaster: Unable to clear cache, mismatched namespace case

Feature

• #2976430 by gagsfitz@gmail.com, Manuel Garcia, cmlara, malcolm_p, jacobbell84, Darvanen, douggreen: Integrate with the key module for access and secret keys
• #3209162 by Simon Peacock, voleger, cmlara: Allow domain name to map directly to root path - D8
• #3204635 by cmlara: Decrease resource utilization when writing files to S3
• #3119586 by cmlara, muaz91: Migrate Drupal 7 to Drupal 8/9
• #3193239 by cmlara: Add new hooks to allow for SSE-C
• #3208666 by cmlara: Copy local based on file stats
• #3207028 by cmlara: Decouple custom endpoint http/https selection from 'use_https' config
• #3202394 by cmlara, Darvanen, daggerhart: Allow private upload of public files
• #3185760 by scott_euser, cmlara: Allow read only use of S3 bucket
• #3163285 by jonathanshaw, cmlara: Don't require use of ListObjectVersions
• #3121830 by ShaunLaws, cmlara, osopolar, gustavderdrache, zach.bimson, J2: Use CredentialProvider::defaultProvider rather than individual providers

Task

• #3221957 by cmlara: Testing: Upgrade localstack to 0.12.14
• #3117073 by cmlara: Remove access_key and secret_key from s3fs.settings
• #3201248: Disallow realtime unknown file lookup to S3
• #3206492: Refactor tests to be in ./tests folder.
• #3206493: Add ability for Drupal CI to execute functional tests

API Changes

• #3193239, #3219822:Added hooks hook_s3fs_stream_open_params_alter, hook_s3fs_copy_params_alter, hook_s3fs_command_params_alter
• #3219227: Constructor change TypeHint's to use interfaces.
• #3204635: S3fsFileService constructor requires additional services.