That and the fact that everything is 64 bit now. The Linux kernel is certainly much bigger though and probably has many more drivers loaded.

It is not one factor but the size of a single bitmap of the screen is certainly an issue.