Replying to my own question - apparently the invites and assignment were executed on the next nightly cron.

The bit of confusion was in that the number of users in the audience already appeared in the program assignment screen but they were only actually assigned on the following day.