That's a consequence of the UI pattern - when you use the same widget as indicator and input, you need some way to represent "no vote yet" - plus, it would be hard to click/tap "no stars". It could be done better but alas, minimalism is the name of the game.