Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
willj
49 days ago
|
parent
|
context
|
favorite
| on:
LLMs as the new high level language
A temperature of 0 doesn’t result in the same responses every time, in part due to floating-point precision and in part to to lack of batch invariance [1]
[1]
https://thinkingmachines.ai/blog/defeating-nondeterminism-in...
properbrew
49 days ago
[–]
Thank you for this, this was a really interesting read about batch invariance, something I didn't even know about.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
[1] https://thinkingmachines.ai/blog/defeating-nondeterminism-in...