LLMs have non-deterministic outputs, meaning you can't exactly predict what they'll say.
I mean...they can have non-deterministic outputs. There's no requirement for that to be the case.
It might be desirable in some situations; randomness can be a tactic to help provide variety in a conversation. But it might be very undesirable in others: no matter how many times I ask "What is 1+1?", I usually want the same answer.
kassiopaea@lemmy.blahaj.zone
on 16 Sep 21:42
collapse
In theory, it’s just an algorithm that will always produce the same output given the exact same inputs. In practice it’s nearly impossible to have fully deterministic outputs because of the limited precision and repeatability we get with floating point numbers on GPUs.
AmanitaCaesarea@slrpnk.net
on 16 Sep 09:13
nextcollapse
Google and privacy in the same sentence… Lol
HappyFrog@lemmy.blahaj.zone
on 16 Sep 19:54
nextcollapse
threaded - newest
Privacy preserving? More like avoiding lawsuits due to copyrighted information
This! Plus opening up the possibility for Google to use private user data with even less concern. So not a privacy win at all.
I mean...they can have non-deterministic outputs. There's no requirement for that to be the case.
It might be desirable in some situations; randomness can be a tactic to help provide variety in a conversation. But it might be very undesirable in others: no matter how many times I ask "What is 1+1?", I usually want the same answer.
In theory, it’s just an algorithm that will always produce the same output given the exact same inputs. In practice it’s nearly impossible to have fully deterministic outputs because of the limited precision and repeatability we get with floating point numbers on GPUs.
Google and privacy in the same sentence… Lol
What does people use a 1b model for?
Google and Privacy can't exist in the same sentence.