Create a User Reference View based on the value of another referenced nodes field

I am making a Project Management feature with Projects, Tasks, Milestones, Project Members, and Assignees.

Projects have a Project Members user reference field where you include the users that are a part of the project. My goal with this is when you click Add Task, the Assignee field only shows the users related to the referenced Project.