Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You still have to include the entire previous conversation, even with the API.


There is no "state" beyond this. It's a functional interface, if you will.



There are alternative UI designs that would make it easier to deal with, though. It could be a tree structured conversation. Or, have a way to clone a previous conversation, delete the last few messages, and continue from there.


OpenAI's playground has exactly this.

You can use the history function to go to any point in time, and then delete a few messages and continue from there.


The results are not deterministic either since random sampling is involved.


evem if you do that you are limited to 4096 tokens so you emd uo havimg ti drop older messages to allow ot to fully generate replies




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: