Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

LLM chat models are not autocomplete. They can recognize and respond to user text, which is not the same thing as completing it. If you prompted GPT-2 with a question you'd get another question, not an answer.


They are autocomplete, they're just completing something in the form

Assistant: ...

User: ...

Assistant: ...

And the output is stopped when they start generating the equivalent of "User: " and the reins are handed back to you.

This isn't a problem, autocomplete at the level of "what would a person say next" is outrageously powerful, but it is how they're working afaik.




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: