Impartiality has nothing to do with whether they are guilty or not.
What the hell are you smoking? By your reasoning, one of the accused could act as their own judge and the ruling would be completely valid despite them not being impartial.
Impartiality has EVERYTHING to do with the validity of any ruling.