If you pay attention to the commas the structure of the law is:

If you do A OR B based on C

A: Deprivation of rights B: Different punishments

where C is on account of such person being an alien, or by reason of his color, or race

I removed B to make it more readable in my initial comment because you were only talking about A.