This is what happens in practice, but in theory you're not supposed to live and work from somewhere without the appropriate visa. All German residents are expected to have a residence permit (if non-EU) and to pay taxes in Germany.

It's just not possible to enforce that.