Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

>Hosted chat API here

Very strange: When I turn the temperature to 1.25 to 1.5 I get much more interesting responses, but they are very ungrammatical with missing punctuation, misspelled words, dropped linking/transition words, etc.

When I try out finer gradations converging on 1 from > 1 and < 1 temperatures, responses < 1 tend to be more orderly and structured including bullet points, while > 1 are much more free form, and increasingly outright chaotic and incomprehensible at > 1.5.



Isn't that pretty much expected?


In other models I definitely get wider responses with higher temperature, hallucinations too, but not a breakdown in structure with endless sentences, few line breaks, poor spellings and grammar, etc. Though I've not tested for such things systematically-- this is the first time I've notices this sort of behavior in a model.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: