Just finished the first draft of my weekend project. Sadly my industry is far away from all the exciting machine learning developments happening right now, so I wrote this project as my first exploration into the world of LLMs. It's not perfect, but I'm excited to see where the project goes from here!
https://github.com/clarkmcc/chitchat
My main motivations were:
- Easy-of-use: Many models are supported out-of-the-box so users don't have to figure out how to download, where to save, etc.
- Intuitive: A clean interface
- Cross platform: The project is written in Rust and cross-compiled to other platforms. You don't have to have Python or the C++ toolchain installed to use.
- Chat-based experience: Model sessions are persisted so the model is contextually aware of your conversation.
