Yes I've had this idea before too. I also think that the votes should be applied to the score in reverse order of the time at which they were made. This means that those who vote earlier end up having more effect on the final score, rather than none at all, as would be the case otherwise.