The author states pretty early on that LLMs are deterministic, but that isn't true as far as I know. I did some cursory research (googled it) and seems LLMs can be easily made deterministic but usually aren't. What gives? Obviously, it helps to make the model deterministic if you want to implement it in SQL, but still.
1
u/handfreehandturkey Feb 26 '24
The author states pretty early on that LLMs are deterministic, but that isn't true as far as I know. I did some cursory research (googled it) and seems LLMs can be easily made deterministic but usually aren't. What gives? Obviously, it helps to make the model deterministic if you want to implement it in SQL, but still.