{"name":"LLM Wiki: Build a Self-Maintaining, Interlinked Knowledge Base with AI","description":"LLM Wiki is a powerful cross-platform desktop application designed to transform your documents into an organized, interlinked knowledge base automatically. Unlike traditional RAG systems, it incrementally builds and maintains a persistent wiki from your sources, ensuring knowledge is compiled once and kept current. This innovative approach offers a dynamic and evolving personal knowledge management solution.","github":"https://github.com/nashsu/llm_wiki","url":"https://osrepos.com/repo/nashsu-llm_wiki","source":"osrepos.com","sourceDescription":"This repository profile is provided by osrepos.com, an open source repository discovery platform.","repositoryProfile":"https://osrepos.com/repo/nashsu-llm_wiki","generatedFor":"open source discovery and AI-assisted research","markdown":"https://osrepos.com/repo/nashsu-llm_wiki.md","json":"https://osrepos.com/repo/nashsu-llm_wiki.json","topics":["LLM","Knowledge Base","Personal Knowledge Management","Desktop App","TypeScript","Rust","AI","RAG"],"keywords":["LLM","Knowledge Base","Personal Knowledge Management","Desktop App","TypeScript","Rust","AI","RAG"],"stars":null,"summary":"LLM Wiki is a powerful cross-platform desktop application designed to transform your documents into an organized, interlinked knowledge base automatically. Unlike traditional RAG systems, it incrementally builds and maintains a persistent wiki from your sources, ensuring knowledge is compiled once and kept current. This innovative approach offers a dynamic and evolving personal knowledge management solution.","content":"## Introduction\n\nLLM Wiki is an innovative, cross-platform desktop application designed to transform your diverse documents into an organized, interlinked knowledge base automatically. Moving beyond traditional Retrieval Augmented Generation (RAG) systems, which retrieve and answer from scratch every time, LLM Wiki incrementally builds and maintains a persistent wiki from your sources. This ensures that knowledge is compiled once and kept current, rather than being re-derived with every query.\n\nThe project is based on Andrej Karpathy's influential LLM Wiki pattern, a methodology for constructing personal knowledge bases using Large Language Models. LLM Wiki is created and maintained by nash_su, who has implemented these core ideas as a full desktop application with significant enhancements.\n\n## Why Use LLM Wiki and Key Features\n\nLLM Wiki offers a comprehensive solution for personal knowledge management, distinguishing itself with a suite of powerful features:\n\n*   **A Self-Building Personal Knowledge Base**: At its core, LLM Wiki reads your documents, constructs a structured wiki, and keeps it updated autonomously. This incremental approach saves time and ensures a consistently current knowledge repository.\n\n*   **Full Cross-Platform Desktop Experience**: Unlike abstract patterns, LLM Wiki provides a complete desktop application with a three-column layout (Knowledge Tree/File Tree, Chat, Preview), an icon sidebar for navigation (Wiki, Sources, Search, Graph, Lint, Review, Deep Research, Settings), custom resizable panels, and an activity panel for real-time processing status. All state, including conversations and settings, is persistently saved.\n\n*   **Advanced Document Ingestion**:\n    *   **Two-Step Chain-of-Thought Ingest**: LLM Wiki first analyzes sources to identify key entities, concepts, and connections, then generates wiki pages with source traceability and incremental caching.\n    *   **Multimodal and Multi-format Support**: It ingests a wide array of formats including PDF, Office documents (DOCX, PPTX, XLSX), EPUB/MOBI, Org mode, images, media, and web clips. It also features multimodal image ingestion, extracting embedded images and generating factual captions.\n    *   **Intelligent Folder Import & Auto-Watch**: Recursive folder import preserves directory structure, using folder context as an LLM classification hint. It also automatically detects external changes in source folders to keep the wiki synchronized.\n\n*   **Dynamic Knowledge Graph and Insights**:\n    *   **4-Signal Relevance Model**: A robust knowledge graph visualization and relevance engine uses direct links, source overlap, Adamic-Adar, and type affinity to map connections.\n    *   **Louvain Community Detection**: Automatically discovers knowledge clusters based on link topology, providing cohesion scoring and distinct visual separation.\n    *   **Graph Insights**: The system analyzes graph structure to surface actionable insights, such as surprising connections and knowledge gaps (isolated pages, sparse communities, bridge nodes), with one-click Deep Research integration.\n\n*   **Optimized Query Retrieval Pipeline**: LLM Wiki employs a multi-phase retrieval pipeline that includes tokenized search, optional vector semantic search via LanceDB, and graph expansion. It features configurable context windows and prioritizes pages by combined search and graph relevance scores, ensuring efficient and accurate answers with cited references.\n\n*   **Rust Backend Chat Agent & Skills**: The chat functionality runs through a powerful Rust backend Agent runtime, enabling tool-using capabilities for wiki search, source search, graph search, web search, and workspace file generation. It supports skill management, allowing users to enable or disable skills and interact with generated workspace outputs.\n\n*   **Enhanced Content Rendering and Review**:\n    *   **Rich Markdown Support**: Features KaTeX rendering for mathematical formulas and Mermaid code blocks for direct diagram rendering in chat and preview.\n    *   **Asynchronous Review System**: LLM flags items needing human judgment during ingest, generating predefined actions and optimized search queries for convenient user review without blocking the ingest process.\n\n*   **Deep Research and Web Clipping**:\n    *   **Deep Research**: When knowledge gaps are identified, LLM Wiki can perform web searches via Tavily, SerpApi, or SearXNG, synthesize findings into new wiki pages, and auto-ingest the results.\n    *   **Chrome Web Clipper**: A dedicated Chrome Extension allows one-click web page capture with accurate article extraction and HTML to Markdown conversion, automatically ingesting clipped content into your knowledge base.\n\n*   **Robust Document Management and Cross-Platform Compatibility**:\n    *   **Intelligent Cascade Deletion**: Deleting a source file triggers a smart cleanup, removing related wiki pages and dead wikilinks while preserving shared entities.\n    *   **Cross-Platform Design**: Built with Tauri v2, it ensures native desktop performance on macOS, Windows, and Linux, with careful handling of path normalization and Unicode-safe string handling.\n\n## Installation\n\nGetting started with LLM Wiki is straightforward, whether you prefer pre-built binaries or compiling from source.\n\n### Pre-built Binaries\n\nThe easiest way to install is by downloading the latest release from the official GitHub Releases page:\n\n*   **macOS**: `.dmg` (supports Apple Silicon and Intel)\n*   **Windows**: `.msi`\n*   **Linux**: `.deb` / `.AppImage`\n\nYou can find the releases here: [https://github.com/nashsu/llm_wiki/releases](https://github.com/nashsu/llm_wiki/releases){target=\"_blank\"}\n\n### Build from Source\n\nFor those who prefer to build the application themselves, follow these steps:\n\n1.  **Prerequisites**: Ensure you have Node.js 20+, Rust 1.88+, and `protoc` installed.\n    *   macOS: `brew install protobuf`\n    *   Linux: `sudo apt install protobuf-compiler`\n    *   Windows: `choco install protoc`\n2.  **Clone the repository**:\n    bash\ngit clone https://github.com/nashsu/llm_wiki.git\ncd llm_wiki\n    \n3.  **Install dependencies and build MCP server**:\n    bash\nnpm install\nnpm --prefix mcp-server ci && npm run mcp:build\n    \n4.  **Run or build**:\n    bash\nnpm run tauri dev      # For development\nnpm run tauri build    # For production build\n    \n\n### Chrome Extension\n\nTo install the Web Clipper Chrome Extension:\n\n1.  Open `chrome://extensions` in your browser.\n2.  Enable \"Developer mode\".\n3.  Click \"Load unpacked\".\n4.  Select the `extension/` directory from the cloned repository.\n5.  Customize the clipping shortcut at `chrome://extensions/shortcuts` (default: `Alt+Shift+L` or `Command+Shift+L` on macOS).\n\n## Examples\n\nTo quickly experience LLM Wiki, follow these steps:\n\n1.  Launch the application and create a new project, choosing from available templates.\n2.  Navigate to **Settings** and configure your LLM provider, including the API key and model. Optionally, set up Web Search providers and source folder auto-watch.\n3.  Go to **Sources** and import your documents, such as PDFs, DOCX files, or Markdown.\n4.  Observe the **Activity Panel** as LLM Wiki automatically processes your documents and builds wiki pages.\n5.  Utilize the **Chat** interface to query your newly created knowledge base.\n6.  Explore the **Knowledge Graph** to visualize connections between your knowledge entries.\n7.  Check the **Review** section for any items requiring your attention or judgment.\n8.  Periodically run **Lint** to maintain the health and consistency of your wiki.\n\n## Links\n\n*   **GitHub Repository**: [https://github.com/nashsu/llm_wiki](https://github.com/nashsu/llm_wiki){target=\"_blank\"}\n*   **Releases Page**: [https://github.com/nashsu/llm_wiki/releases](https://github.com/nashsu/llm_wiki/releases){target=\"_blank\"}\n*   **Chrome Extension**: Available within the `extension/` directory of the GitHub repository.\n*   **LLM Wiki Agent Skill**: [https://github.com/nashsu/llm_wiki_skill](https://github.com/nashsu/llm_wiki_skill){target=\"_blank\"}","metrics":{"detailViews":0,"githubClicks":0},"dates":{"published":null,"modified":"2026-09-23T15:13:25.000Z"}}