When the device is doing nothing it should use no power. The goal is to get to 'doing nothing' as fast as possible.

That's a legacy of iPhone. And that's a fundamental philosophical difference between Apple and everyone else.

I suspect that's why Apple's caches are structured the way they are: the goal is to stop working. More instruction cache means more work, which leads to less work.