The involuntary wealth transfer of slavery was from slaves to the rich, not the other way around. Framing it as the slaves taking from the rich when they stopped being slaves by no longer providing free labor is monumentally disingenuous, and I don't think you really believe that.