Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

They reduced the cache TTL to one hour so if you leave your prompt sitting idle for an hour at 700,000 tokens the next time you hit enter send it it will be completely uncached and eat a ton of tokens. Something to look at.
 help



Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: