In this case though, the algorithm should be just as useful to closed models as to open models. There is nothing there that is optimised specifically for Mistral - aside from the hard-coded dimensions in multiple places in the code :D
Having said that, it's awesome to have open source models out there, and I hope they will ultimately win in the end.
Having said that, it's awesome to have open source models out there, and I hope they will ultimately win in the end.