As a manager - my work habits look pretty similar. If you don't trust your peers or reports, such that you need to monitor the specific hours they're doing asynchronous/solo work, then that's a problem.
The challenge is actually getting people to take advantage of this. I work with folks who default to overworking, so I have to be pretty insistent that they take time for themselves.
I currently have a manager like you and honestly this is worth a lot. It's basically part of my compensation, almost like being paid in time.
The peace of mind that comes with knowing that when I say "Hey, sorry, I need to take Wednesday off" the reply will be "Hope you've got something fun planned!" instead of the likes of "Hmm, well, we were ahead last sprint so if we slip this one it's okay" is incalculable. (I probably don't have something fun planned, but the sentiment is appreciated.)
Yup. I've left most jobs in the past because of a bad to okay manager. I've stayed at jobs that honestly I should have left sooner because of great managers.
Good managers help you improve your skills, give you meaningful feedback, facilitate work getting done, and get out of your way.
The challenge is actually getting people to take advantage of this. I work with folks who default to overworking, so I have to be pretty insistent that they take time for themselves.