I use a tall glass with tap water and some dish soap. Dunk them in while I shower, then remove, rinse off with cold water. Afterwards I could use a towel, but actually I tap them dry with a sheet of toilet paper. I THOUGHT that would leave small dust, but surprisingly, does not.

I use cheap, uncoated glasses though and replace them every 3-4 years anyways.