TAC Lite with domain access / ACB

I already have a site working with TAC lite.

Almost 25 roles are created and 10000 nodes added to existing site. And 185 modules.
Each user can have multiple roles.

Now we want to create a multisite using domain access to share only some content.

Have to add "Access Control Bridge" module to make all permission work nicely together.
Works well with admin login as well as an anonymous user.

But for other users with some other roles, pages running out of memory.

I already have 1 GB php memory limit.

Disabling any of the module (DA / TAC lite) works.

Is there a way to make both working together?

Can't change site functionality a lot as it already has so many users / nodes.