Hi Paul
I can't think of a way of doing this with audiences, there is a way of restricting by a user's direct reports , position or organisation.
In Totara 10 the browse list of users is an embedded report - the content tab of the report can be edited to show a user's direct reports, position or organisation. This would affect the report for all users.
regards