It is possible to filter the gradebook to only see assignments in one category along with the category average.
Clicking on the menu All Categories displays a list of all of your categories:
Clicking on any one category then causes the gradebook to show only assignments in the selected category along with the category average.
Selecting All Categories turns off the category filter.