Improvements for types, memory and reusability

Problem/Motivation

We should include a few new improvements which includes:

• Making the entity key dynamic
• Update the output to use io and improve readability
• Update logger to use promotion
• Add chunking method to avoid memory issues on large sets
• Move revision id querying work into the queue for faster adding
• Move functions into a service class for reusability

This should allow us to expand later if we want.