Archive Project Tasks

When using the Task tab All of our projects are showing, even the archived projects. This is an issue for when we are trying to quickly look at what tasks we have and need to assign to team members. We only want to see current projects tasks. How do we remove archived projects tasks completely?