I never really thought of using relays, just not into them. There's a chap called Harry Porter someone mentions below who has built a processor out of relays which looks very impressive.
My starting point was that I was trying to learn about transistors and was looking for ideas of something to build.