YES! That was an idea I had a year ago actually! I wanted to lobotomize models, cutting out weights and leaving only functionality that we want. Unlike distillation it would be a much more brutal process.

The idea went nowwhere for the time being, but if I ever get back to it, the project surely will be called Lobotomizer.