Hi Michelle,
We have a Feature request in for functionality which could help you here. Unfortunately you can't hide the categories at present when you are using Audience visibility. We are looking to bring out this functionality in an evergreen release, but at present I couldn't give a date.
regards,
George.