Agree with this, but add it so that you can't change when fighting. Or maybe make a shop where you can retrain your minions. But I also agree to make it 5 resources (coins or wood depending on class) so ppl just don't abuse the ability.

I've seen this happen, but it fixes itself automatically in a few seconds