Usually that's a different cache, but even if it's the same, the code is usually smaller.

But you bring a good point - for example on certain platforms (certain game consoles for example), where memory, and cache miss is expensive, often compiling with -O1 rather than -O2 (inline expansion) is better.