remove role assignment from inactive users

Where a staff member has left the company their user profile is made inactive..
We still see inactive users in the role allocation in map view.
Suggest an option to remove users from role assignment at the point where the user is made inactive.