I live in an apartment in a UK 1850s house, it just has solid exterior walls.

I think there are now heat pumps that are a similar size to a gas combi boiler and are designed to be inside a building, not a big box outside.