Create private download directory per user instead of per role?

Is there a way that I can use the Private Download module to create a directory that only a specific user can download from? I assume I'd need to use another module as well to do this, given that Private Download only appears able to restrict access by role, not per user.

I want to be able to let users store files on my site that only they can access, and I'd much rather use Drupal than give each of them an FTP account with their own directory, etc.

The creation of the directories can be manual, as I don't need to give this feature to every user. But if there's a way to do it automatically, that would be great too.

Any help would be greatly appreciated.