Hacker Newsnew | past | comments | ask | show | jobs | submit | tokfan's submissions login

1. Tokenizers (huggingface.co) 2 points by tokfan 5 months ago | past 2. LLM Tokenization Demo (github.com/tokfan) 2 points by tokfan 5 months ago | past 3. Sampling – Model Context Protocol (modelcontextprotocol.io) 3 points by tokfan 5 months ago | past 4. What Is LLM Tokenization and Why Is It Important? (medium.com/thinking-sand) 1 point by tokfan 5 months ago | past 5. All you need to know about Tokenization in LLMs (medium.com/thedeephub) 2 points by tokfan 5 months ago | past 6. Tokenization in Large Language Models (seantrott.substack.com) 2 points by tokfan 5 months ago | past

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact Search: