Import taxonomy take forever to init

I meet the issue when force import taxonomies
- Go to /admin/structure/structure-sync/taxonomies
- Click Import taxonomies (force)
batch run, stuck at batch init and takes forever to start.
Please see attachment, I let it run about 30 mins for an empty site with about 50 taxonomies/terms