Hi Oliver
There are some capabilities that only take effect when applied at a site level and deleted enrolled learning from an audience may be one of these.
The site manager is aimed at being applied at a system level. If you have allowed all of the audience permissions already then think this is one of these cases.
Regards