The page at http://drupal.org/node/895314 lists all the modules that have been moved from contrib into core.
Some of these modules have been moved completely from contrib into core, where others have had selected components moved from contrib into core.
Depending on the module, the upgrade path and procedures will differ.
The handbook page should be organized to reflect this, and linked to from within the UPGRADE.TXT file.
If documentation people think this is a good idea, then we can move forward with this.
If documentation people think this is a bad idea, shoot it down in flames!