Hi Raechel,
We had a similar issue with users deciding a course wasn't appropriate after viewing the course page but the course would stay on their record even after unenrolling.
We found this was happening because people were being marked as 'In Progress' as soon as they enrolled in the course just to view it. There is a setting called 'Mark as In Progress on first view'. We now have this unticked and users can now view a course page and when they unenroll the course disappears for their record. You can find the setting in Course administration>Edit settings>Completion tracking.
We found it better than guest access as my understanding is anyone, even people without accounts, can view a course if you have guest access turned on. I could be wrong about that though.
Cheers
Nathan