Private Files 404 not found

I have setup s3 for private files. Upload works. If i set the config to 'public' => TRUE i can download the file as i see the direct linke. When i remove that line it generates the following and i get the response

http://domain.net/en/_flysystem/s3-private/2020-03/filename_test.mp4

404 Not Found

The whole config

's3-private' => [
    'driver' => 's3',
    'config' => [
      'key'    => 'AKIA4HWKRFHN3BU4T6WL',      // 'key' and 'secret' do not need to be
      'secret' => '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',   // provided if using IAM
      'region' => 'eu-west-1',
      'bucket' => 'd8-skybo-shop-private',