Form display UI not Ufriendly

Use case:
Users can create nodes and add users to grant "view." (I'm also using "Node access user reference")

Everything works fine, but the author's UI looks a little messy. Like "drag handles". Why would authors need to reposition users? When I have the field set to "unlimited" the "Add new item" should read "Add new user" or just "Add another." Also there's no "delete" user function i.e., authors must highlight and delete added users from field then save. There's no heading for the table to describe what its there for, although a static field or block can do the job. The field includes the Username + UID. I would like to not display my user's UID's. Username are required to be unique by Drupal so I'm not sure what the display of UID does? Also, it should be required that a minimum number of characters be entered for autocomplete (greater than 1) before it begins looking for matches. I expect 100K + users. This could be a big draw on resources if an author uses only one character to search for a name. I could be wrong though since I have no way of testing this..yet.

Authors can also add the same user multiple times. I've tested this and it does no harm except that if an author accidentally enter the same user 20 users later and then decides to remove that user they will not realize (in an obvious way) that the user they just removed still has permission to view because they still reside in the table.