We used sleeping bags sometimes during winters growing up because we were poor, and that was a cheaper solution to apartment heating. I actually liked it sometimes because it felt like we were camping...another thing that i hadn't done when i was younger due to lack of funds.
....By the way, you're not weird for using sleeping bags; you're fun! :-)
We used sleeping bags as blankets growing up because we were weird I guess.