Innovation Refunds—Internal Knowledgebase Chatbot
Developed a custom chatbot to answer questions to internal, enterprise users based on a Knowledgebase of documents maintained in Contenful. The software used reasoning/action (reAct) and retrieval augmented generation (RAG), as well as related techniques such as contextual compression. It included vector DBMS migrations from Annoy to Chroma to PGVector, primarily using the GPT-4 LLM, but with prototyping of Llama-2 fine-tune open-source models.