It's a bit like the bit with the fake tan in Neuromancer.

"You think that looks real?"

"Nah, but it looks like you care enough to fake it."

If you care enough to move your ssh port you're probably not totally clueless at best, and at worst you're setting out bait.