I had this same problem for years. 18 months ago, I started carrying around a notepad (Field Notes) and clicky pen everywhere to make sure I could get everything down, and it's made a huge difference.

At the end of every day, I process the last day's worth of notes. Appointments/meetings go onto my calendar, tasks go into TeuxDeux, and cash expenses go into YNAB.