Nothing to be embarrassed about. This stuff is very "use it or lose it" so unless you're really using it regularly, it fades from mind very easily. Heck, I've taken College Algebra like 3 times over the years, and I still keep going back to Khan Academy or watching various Youtube videos and the like, for a refresher here and there. And that's just to keep the basic algebra stuff in mind.