Annoyance: private->public files don't return back to their original place

I am not sure if it should be a bug report or a feature request. But I consider it more a bug.
From my point of view, private upload should be reversible (it is indeed if we talk about functionality) but I consider a file that goes back from private to public, should return to the subdirectory it came from, not to /files. The original path it was stored in should be saved in case it has to be returned there.