RAG + Local LLM: How to Build Your Own Knowledge System

In this talk, we will explore why a RAG (Retrieval-Augmented Generation) approach and a local LLM are needed, and how they help build an effective knowledge management system. Step by step, we will walk through the implementation journey — from data preparation to a fully functioning system — with a focus on architecture, quality testing, and performance.

We will share the key challenges we faced and the solutions that proved effective in practice. We will demonstrate the results achieved and the impact on the team, as well as outline our plans for further development. The talk will conclude with insights and practical advice for those who are just starting to work with RAG and local LLMs.