refreshCache() method in S3fsService class does not properly fetch and iterate data data from S3.
Due to limitation in S3 API a request only can only fetch 1000 items therefore iterator should be used to get all items metadata.

CommentFileSizeAuthor
#2 metadata_cache_refresh-2890617.patch1.72 KBdidaka

Comments

didaka created an issue. See original summary.

didaka’s picture

didaka commented
StatusFileSize
new metadata_cache_refresh-2890617.patch1.72 KB
didaka’s picture

didaka commented
Status: Active » Closed (duplicate)

Duplicates #2878923: S3FS works wrong if there are more than 1000 files in a bucket

didaka’s picture

didaka commented
Related issues: +#2878923: S3FS works wrong if there are more than 1000 files in a bucket