The main problem is inflation, and the second problem is that most houses are owned by people (boomers and silent gen people) who already have a lot of wealth (not millionares or anything but they got the opportunity to buy cheap and save for longer time) so there is no real incentive to make housing prices go down and make the net worth of that demographic plummet (you must also remember that almost all politicians belong to that same demographic).
So basically us young and poor people are financing the wealth and comfort of the older generation through inflation.