Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

That's an implementation detail I believe. But what I meant was just greedy decoding (picking the token with the highest logit in the LLM output), which can be implemented very easily


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: