What does it mean when it asks if I want files to be Public or Private? Which would be better for a site?

I am guessing that when it says Public, it means that the files could potentially be hotlinked but private would mean the files being sent to the user by Drupal?