Hi Jo,
This should be straightforward providing you have a rule which captures only the users who you dont't want in the audience. Then its just a case of using the 'And is not'.
Can you provide some more detail about your scenario and how you tried to resolve it?
cheers,
George.