Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

* when you have a good internet connection

** when you live in the USA



> * when you have a good internet connection

Or at least, a good enough internet connection to send plaintext.

> * when you live in the USA

Even from Australia to USA is just ~300ms of latency for first token and then the whole thing can finish in ~1s. And making that faster doesn't require on-device deployment, it just requires a server in Australia - which is obviously going to be coming if it hasn't already for many providers.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: