My thoughts on I asked Local LLM to add 23 numbers, I got 7 different wrong answers.: I asked Local LLM to add 23 numbers, I got 7 different wrong answers.

Commentary

  • I asked Local LLM to add 23 numbers, I got 7 different wrong answers.
  • My last sentence was jinxed. LLMs can’t do math yet. Sigh!
  • I did explore this last year and they failed miserably, till date this hasn’t improved. I think we can create a skill for this shall we, I don’t want it to use a python interpretter for such a trivial thing to add. Can we make them add? It would consume a bit more tokens but let’s see. I have some ideas here.
  • But the point being, Local LLMs are not quite the hype that the propreitary models live up to.