My thoughts on LLM Knowledge Bases: LLM Knowledge Bases

Commentary

  • LLM Knowledge Bases
  • This is neat stuff. I don’t have any wikis like that. I haven’t explored something that deep that requires more than 10k lines of content. I think I need to read one deep posts or a book. I do read some short-form content like other people’s thoughts and TILs, which is not bad but not really putting my brain to think.
  • I have seen Grok do really good extraction of information (not presenting the right way, though its not a great model for conversation, I suppose). LLMs are actually getting good at summarisation and linking different ideas together. Some times they are a bit cringe and try to shoehorn some weird analogy, which I have noticed.