• 33 Posts
  • 942 Comments
Joined 2 years ago
cake
Cake day: June 14th, 2023

help-circle





  • Okay but in casual conversation I probably couldn’t spot a really good LLM on a thread like this, but on the back end that LLM is completely incapable of learning or changing in any meaningful way, its not quite a chinese room as previously mentioned but it’s still a set model that can’t learn or understand context, even with infinite context memory it could still only interact with that data within the confines of the original model.

    e.g. I can train the model to understand a spoon and a fork, it will never come up with that idea of a spork unless I re-train it to include the concept of sporks or directly tell it. Even after I tell it what a spork is it can’t infer the properties of a spork based on a fork or a spoon without additional leading prompts by me.






  • Americans are actually a bit closer than the rest of us, e.g. erbs is the original pronounciation of herbs with the H being picked up in the UK initially by the upper classes and eventually everyone else, literally just because it sounded more grandiose, though the root latin word does include an h. (the presence of an H in english has been intermittent)

    Aluminum is also closer to the intended pronounciation at least by the guy who came up with the first decent process for refining it.