Have you tried the "Only cohort members" option in the self-enrolment method (at the course level)?

Create an audience based on users who have completed your prerequisite courses, then select that audience in the self enrolment settings. In theory (I've not tested it), that would restrict users from self-enrolling until they've completed the prerequities.

Regards,

Ryan