By that criteria, wouldn't a discrete distribution with infinite support be even more random?

Finite support somehow seems less random because you can still say something interesting about its mean and bounds in the same way you can say something about the mean and variance of a normal distribution.