It appears that I spoke a little too soon about this issue. As you can see below, when a glossary is created which isn't used in any section, it appears at the top of the course, and can be deleted from there. More of a bug than a feature I suspect, but it does at least provide a workaround!
![](https://totara.community/pluginfile.php/26528/mod_forum/attachment/68892/screenshot.png)
![](https://totara.community/pluginfile.php/26528/mod_forum/attachment/68892/screenshot.png)