Refactor token preparation tasks into new routine

Problem/Motivation

Refactor token preparation tasks into new routine. This will streamline the main builder routines called by users of the parser.

Proposed resolution

See patch(es).

Remaining tasks

Before committing, code will be reviewed, tested against D8 core files, and documentation updated.

User interface changes

Not applicable.

API changes

To be completed later.