My advice is to ask to hiring manager who invites you to come in about the dress code expectation / norms, and try to be on the higher end of the range they give, without going over.

I agree no one will explicitly decide one way or another based on how you dress. But making everyone in the room feel comfortable with each other will help the whole process.