That's very cool. How does it work? Do you train a model for each "library"?

punkspider · on Feb 23, 2023

Lately LangChain[1] and GPT-Index[2] are very popular libraries for this sort of thing.

This is the vid I started out with https://www.youtube.com/watch?v=rBEHPxVHb5c

Also that channel seems to be great. They focus only on LangChain and GPT-Index lately and post videos every few days https://www.youtube.com/@echohive

Both have Discord servers as well.

Additionally there's also this website for GPT-Index ( https://llamahub.ai/ ) where people add different "connectors", like loading up your .md files, .docx files, your notion, your slack, etc.

  [1] https://langchain.readthedocs.io/en/latest/
  [2] https://gpt-index.readthedocs.io/en/latest/

thundergolfer · on Feb 23, 2023

They say they use LangChain, so it's going to be structurally similar to this MVP side-project: https://thundergolfer.com/infinite-ama.

That's a chat-bot backed by LangChain and OpenAI, which can answer some questions from my knowledge base.

It's WIP, I want to add my HN comments into the mix, but the code is here: https://github.com/thundergolfer/modal-fun/tree/main/infinit...

Vasyl_R · on Feb 23, 2023

we're using LangChain underneath and we also doing RnD on fine-tuning to see and compare performance of different approaches. Can you tell me what file format is your knowledge-base? is it PDF or MS Docs or any other?