I have a musician friend who doesn't think drums are a musical instrument and that drummers are not musicians. As far as I can figure it's has primarily to do with drums not having the same concepts of pitch/melody.

I feel like this is along your line of reasoning- only certain (classical, western) ways of doing music is real music.