In fact if it's not a voice call it should probably be excluded, lol. I feel like semantically right now being on your phone refers to looking at the screen actively, even though that's very much not the origin of the phrase. Yet, nowadays the meaning of the phrase probably excluded when you're holding it to the side of your head, as you're not looking at a screen at all.