Easy, you get other persons to verify them. If you can get them to do that time and again, then you know you have a good memory.

And of course it's not just conversations. One could easily verify his good memory by reciting old things he read (which he can easily check again) etc.