Hi Ellie

It isn't possible to delete a certificate but it is possible to edit the Learner role to prevent the permission View a certificate.

This can be changed at the course level or at a a higher level such as category or site level.

regards