Inference in Python uses harmony [1] (for request and response format) which is ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		lukax 9 months ago \| parent \| context \| favorite \| on: Open models by OpenAI Inference in Python uses harmony [1] (for request and response format) which is written in Rust with Python bindings. Another OpenAI's Rust library is tiktoken [2], used for all tokenization and detokenization. OpenAI Codex [3] is also written in Rust. It looks like OpenAI is increasingly adopting Rust (at least for inference). [1] https://github.com/openai/harmony [2] https://github.com/openai/tiktoken [3] https://github.com/openai/codex

chilipepperhott 9 months ago | [–]

As an engineer that primarily uses Rust, this is a good omen.

Philpax 9 months ago | [–]

The less Python in the stack, the better!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact