diff --git a/README.md b/README.md index f8960121cae73cb2eb0f0fd1878633ab8ddfe627..57c9a5fb65dc0447dac046d8ee0769166c976013 100644 --- a/README.md +++ b/README.md @@ -1,335 +1,70 @@ -# OpenDeepWiki -[中文](README.zh-CN.md) | [English](README.md) -
- OpenDeepWiki Logo -

AI-Driven Code Knowledge Base

-
+# KoalaWiki 项目文档 -# Sponsor +## 项目简介 +KoalaWiki 是一个智能知识库系统，专注于代码仓库的文档生成与管理。它结合了AI技术，提供代码分析、文档生成、对话分享等功能，支持多数据库平台（SQLite、PostgreSQL、SQL Server）。 -[![image](https://github.com/user-attachments/assets/b1bcb56e-38cb-47bf-adfe-7a21d83774b4)](https://share.302.ai/jXcaTv) +## 核心功能 +- 🧠 **智能文档生成**：基于AI模型自动分析代码仓库并生成技术文档 +- 📁 **多级文档目录管理**：支持复杂项目结构的文档组织 +- 💬 **对话式知识分享**：记录并分享开发者间的问答对话 +- 🔄 **多数据库支持**：提供SQLite、PostgreSQL、SQL Server三种数据库实现 +- 🛠️ **微调任务管理**：支持定制化模型训练任务管理 +- 🌐 **多语言支持**：包含国际化前端界面与文档展示 -[302.AI](https://share.302.ai/jXcaTv)is a pay-as-you-go, one-stop enterprise-level AI application platform. It offers an open platform and open-source ecosystem, allowing AI to find solutions for every need. Click [here](https://share.302.ai/jXcaTv) to get your $1 free credit! - -## Function - -- **Quick Conversion:** All Github, Gitlab, Gitee, Gitea and other code repositories can be converted into knowledge bases in just a few minutes. -- **Multi-language Support:** Code analysis and documentation generation are supported for all programming languages. -- **Code Structure:** Automatic Mermaid diagrams are generated to understand the code structure. -- **Custom Models:** Custom models and custom APIs are supported, allowing for expansion as needed. -- **AI Intelligent Analysis:** Code analysis and understanding of code relationships based on AI. -- **Easy SEO:** Generate SEO-friendly documents and knowledge bases using Next.js, making it easier for search engines to index. -- **Dialogic Interaction:** Supports dialogic interaction with AI to obtain detailed information and usage methods of the code, and to deeply understand the code. - -Feature list: -- [x] Supports multiple code repositories (Github, Gitlab, Gitee, Gitea, etc.) -- [x] Supports multiple programming languages (Python, Java, C#, JavaScript, etc.) -- [x] Supports repository management, providing functions for adding, deleting, modifying, and querying repositories -- [x] Supports multiple AI providers (OpenAI, AzureOpenAI, Anthropic, etc.) -- [x] Supports multiple databases (SQLite, PostgreSQL, SqlServer, etc.) -- [x] Supports multiple languages (Chinese, English, French, etc.) -- [x] Supports uploading ZIP files, and uploading local files -- [x] provides a data fine-tuning platform to generate fine-tuning datasets -- [x] Supports directory-level management of repositories, allowing for custom directory generation and dynamic documentation creation -- [x] Supports repository directory management, allowing for modification of repository directories -- [x] Supports user-level management, providing user management functions for adding, deleting, modifying, and querying users -- [ ] Supports user permission management, providing user permission management functions for adding, deleting, modifying, and querying user permissions -- [x] Supports generating different fine-tuning framework datasets at the repository level - -# Project Introduction - -OpenDeepWiki is an open-source project inspired by [DeepWiki](https://deepwiki.com/), developed using .NET 9 and Semantic Kernel. It aims to help developers better understand and utilize codebases by providing features such as code analysis, documentation generation, and knowledge graph creation. -- Analyze code structure -- Understand core concepts of repositories -- Generate code documentation -- Automatically create README.md for code - MCP Support - - -OpenDeepWiki supports MCP (Model Context Protocol) -- Supports providing an MCPServer for a single repository and conducting analysis on a single repository. - -Usage: The following is the usage of cursor: -```json -{ - "mcpServers": { - "OpenDeepWiki":{ - "url": "http://Your OpenDeepWiki service IP:port/sse?owner=AIDotNet&name=OpenDeepWiki" - } - } -} -``` -- owner: It is the name of the organization or owner of the repository. -- name: It is the name of the repository. - -After adding the repository, test by asking a question (please note that before doing this, the repository must be processed first): What is OpenDeepWiki? The effect is as shown in the picture: ! [](img/mcp.png) - - -In this way, you can use OpenDeepWiki as an MCPServer, making it available for other AI models to call upon, facilitating the analysis and understanding of an open-source project. - -## 🚀 Quick Start - -1. Clone the repository -```bash -git clone https://github.com/AIDotNet/OpenDeepWiki.git -cd OpenDeepWiki -``` - -2. Open the `docker-compose.yml` file and modify the following environment variables: - -Ollama: -```yaml -services: - koalawiki: - environment: - - KOALAWIKI_REPOSITORIES=/repositories - - TASK_MAX_SIZE_PER_USER=5 # Maximum number of parallel document generation tasks per user by AI - - CHAT_MODEL=qwen2.5:32b # Model must support functions - - ANALYSIS_MODEL=qwen2.5:32b # Analysis model used for generating repository directory structure - - CHAT_API_KEY=sk-xxxxx # Your API key - - LANGUAGE= # Set the default language for generation as "Chinese" - - ENDPOINT=https://Your Ollama's IP: Port/v1 - - DB_TYPE=sqlite - - MODEL_PROVIDER=OpenAI # Model provider, default is OpenAI, supports AzureOpenAI and Anthropic - - DB_CONNECTION_STRING=Data Source=/data/KoalaWiki.db - - EnableSmartFilter=true # Whether intelligent filtering is enabled or not may affect how the AI can obtain the file directory of the repository - - UPDATE_INTERVAL # Warehouse increment update interval, unit: days - - MAX_FILE_LIMIT=100 # The maximum limit for uploading files, in MB - - DEEP_RESEARCH_MODEL= # Conduct in-depth research on the model and use CHAT_MODEL for the empty - - ENABLE_INCREMENTAL_UPDATE=true # Whether to enable incremental updates - - ENABLE_CODED_DEPENDENCY_ANALYSIS=false # Whether to enable code dependency analysis,This might have an impact on the quality of the code. - - ENABLE_WAREHOUSE_FUNCTION_PROMPT_TASK=false # Whether to enable MCP Prompt generation or not. - - ENABLE_WAREHOUSE_DESCRIPTION_TASK=false # Whether to enable the generation of warehouse Description -``` - - -OpenAI: -```yaml -services: - koalawiki: - environment: - - KOALAWIKI_REPOSITORIES=/repositories - - TASK_MAX_SIZE_PER_USER=5 # Maximum number of parallel document generation tasks per user by AI - - CHAT_MODEL=DeepSeek-V3 # Model must support functions - - ANALYSIS_MODEL= # Analysis model used for generating repository directory structure - - CHAT_API_KEY= # Your API key - - LANGUAGE= # Set the default language for generation as "Chinese" - - ENDPOINT=https://api.token-ai.cn/v1 - - DB_TYPE=sqlite - - MODEL_PROVIDER=OpenAI # Model provider, default is OpenAI, supports AzureOpenAI and Anthropic - - DB_CONNECTION_STRING=Data Source=/data/KoalaWiki.db - - EnableSmartFilter=true # Whether intelligent filtering is enabled or not may affect how the AI can obtain the file directory of the repository - - UPDATE_INTERVAL # Warehouse increment update interval, unit: days - - MAX_FILE_LIMIT=100 # The maximum limit for uploading files, in MB - - DEEP_RESEARCH_MODEL= # Conduct in-depth research on the model and use CHAT_MODEL for the empty - - ENABLE_INCREMENTAL_UPDATE=true # Whether to enable incremental updates - - ENABLE_CODED_DEPENDENCY_ANALYSIS=false # Whether to enable code dependency analysis,This might have an impact on the quality of the code. - - ENABLE_WAREHOUSE_FUNCTION_PROMPT_TASK=false # Whether to enable MCP Prompt generation or not. - - ENABLE_WAREHOUSE_DESCRIPTION_TASK=false # Whether to enable the generation of warehouse Description -``` - -AzureOpenAI: -```yaml -services: - koalawiki: - environment: - - KOALAWIKI_REPOSITORIES=/repositories - - TASK_MAX_SIZE_PER_USER=5 # Maximum number of parallel document generation tasks per user by AI - - CHAT_MODEL=DeepSeek-V3 # Model must support functions - - ANALYSIS_MODEL= # Analysis model used for generating repository directory structure - - CHAT_API_KEY= # Your API key - - LANGUAGE= # Set the default language for generation as "Chinese" - - ENDPOINT=https://your-azure-address.openai.azure.com/ - - DB_TYPE=sqlite - - MODEL_PROVIDER=AzureOpenAI # Model provider, default is OpenAI, supports AzureOpenAI and Anthropic - - DB_CONNECTION_STRING=Data Source=/data/KoalaWiki.db - - EnableSmartFilter=true # Whether intelligent filtering is enabled or not may affect how the AI can obtain the file directory of the repository - - UPDATE_INTERVAL # Warehouse increment update interval, unit: days - - MAX_FILE_LIMIT=100 # The maximum limit for uploading files, in MB - - DEEP_RESEARCH_MODEL= # Conduct in-depth research on the model and use CHAT_MODEL for the empty - - ENABLE_INCREMENTAL_UPDATE=true # Whether to enable incremental updates - - ENABLE_CODED_DEPENDENCY_ANALYSIS=false # Whether to enable code dependency analysis,This might have an impact on the quality of the code. - - ENABLE_WAREHOUSE_FUNCTION_PROMPT_TASK=false # Whether to enable MCP Prompt generation or not. - - ENABLE_WAREHOUSE_DESCRIPTION_TASK=false # Whether to enable the generation of warehouse Description -``` - -Anthropic: -```yaml -services: - koalawiki: - environment: - - KOALAWIKI_REPOSITORIES=/repositories - - TASK_MAX_SIZE_PER_USER=5 # Maximum number of parallel document generation tasks per user by AI - - CHAT_MODEL=DeepSeek-V3 # Model must support functions - - ANALYSIS_MODEL= # Analysis model used for generating repository directory structure - - CHAT_API_KEY= # Your API key - - LANGUAGE= # Set the default language for generation as "Chinese" - - ENDPOINT=https://api.anthropic.com/ - - DB_TYPE=sqlite - - MODEL_PROVIDER=Anthropic # Model provider, default is OpenAI, supports AzureOpenAI and Anthropic - - DB_CONNECTION_STRING=Data Source=/data/KoalaWiki.db - - EnableSmartFilter=true # Whether intelligent filtering is enabled or not may affect how the AI can obtain the file directory of the repository - - UPDATE_INTERVAL # Warehouse increment update interval, unit: days - - MAX_FILE_LIMIT=100 # The maximum limit for uploading files, in MB - - DEEP_RESEARCH_MODEL= # Conduct in-depth research on the model and use CHAT_MODEL for the empty - - ENABLE_INCREMENTAL_UPDATE=true # Whether to enable incremental updates - - ENABLE_CODED_DEPENDENCY_ANALYSIS=false # Whether to enable code dependency analysis,This might have an impact on the quality of the code. - - ENABLE_WAREHOUSE_FUNCTION_PROMPT_TASK=false # Whether to enable MCP Prompt generation or not. - - ENABLE_WAREHOUSE_DESCRIPTION_TASK=false # Whether to enable the generation of warehouse Description -``` - -> 💡 **How to get an API Key:** -> - Get Google API key [Google AI Studio](https://makersuite.google.com/app/apikey) -> - Get OpenAI API key [OpenAI Platform](https://platform.openai.com/api-keys) -> - Get CoresHub [CoresHub](https://console.coreshub.cn/xb3/maas/global-keys) [Click here for 50 million free tokens](https://account.coreshub.cn/signup?invite=ZmpMQlZxYVU=) -> - Get TokenAI [TokenAI](https://api.token-ai.cn/) - -3. Start the service - -You can use the provided Makefile commands to easily manage the application: - -```bash -# Build all Docker images -make build - -# Start all services in background mode -make up - -# Or start in development mode (with logs visible) -make dev -``` - -Then visit http://localhost:8090 to access the knowledge base. - -For more commands: -```bash -make help -``` - -### For Windows Users (without make) - -If you're using Windows and don't have `make` available, you can use these Docker Compose commands directly: +## 技术架构 +系统采用分层架构设计： +- **数据访问层**：通过EF Core实现统一数据接口（IKoalaWikiContext） +- **领域模型层**：包含仓库(Warehouse)、文档(Document)、用户(User)等核心实体 +- **服务层**：提供认证、代码分析、文档生成等业务服务 +- **AI集成层**：集成OpenAI兼容接口用于代码理解与文档生成 +- **前端界面**：基于Next.js的响应式Web应用，支持SSR +## 快速启动 ```bash -# Build all Docker images +# 构建所有镜像 docker-compose build -# Start all services in background mode +# 启动服务（后台模式） docker-compose up -d -# Start in development mode (with logs visible) +# 开发模式启动（查看日志） docker-compose up - -# Stop all services -docker-compose down - -# View logs -docker-compose logs -f -``` - -For building specific architectures or services, use: - -```bash -# Build only backend -docker-compose build koalawiki - -# Build only frontend -docker-compose build koalawiki-web - -# Build with architecture parameters -docker-compose build --build-arg ARCH=arm64 -docker-compose build --build-arg ARCH=amd64 -``` - - -### Deploy to Sealos with Public Internet Access -[![](https://raw.githubusercontent.com/labring-actions/templates/main/Deploy-on-Sealos.svg)](https://bja.sealos.run/?openapp=system-template%3FtemplateName%3DOpenDeepWiki) -For detailed steps, refer to:[One-Click Deployment of OpenDeepWiki as a Sealos Application Exposed to the Public Network Using Templates](scripts/sealos/README.zh-CN.md) - -## 🔍 How It Works - -OpenDeepWiki uses AI to: - - Clone code repository locally - - Analyze based on repository README.md - - Analyze code structure and read code files as needed, then generate directory json data - - Process tasks according to directory, each task is a document - - Read code files, analyze code files, generate code documentation, and create Mermaid charts representing code structure dependencies - - Generate the final knowledge base document - - Analyze repository through conversational interaction and respond to user inquiries - -```mermaid -graph TD - A[Clone code repository] --> B[Analyze README.md] - B --> C[Analyze code structure] - C --> D[Generate directory json data] - D --> E[Process multiple tasks] - E --> F[Read code files] - F --> G[Analyze code files] - G --> H[Generate code documentation] - H --> I[Create Mermaid charts] - I --> J[Generate knowledge base document] - J --> K[Conversational interaction] -``` -## Advanced Configuration - -### Environment Variables - - KOALAWIKI_REPOSITORIES Path for storing repositories - - TASK_MAX_SIZE_PER_USER Maximum parallel tasks for AI document generation per user - - CHAT_MODEL Model must support functions - - ENDPOINT API Endpoint - - ANALYSIS_MODEL Analysis model for generating repository directory structure - - CHAT_API_KEY Your API key - - LANGUAGE Change the language of the generated documents - - DB_TYPE Database type, default is sqlite - - MODEL_PROVIDER Model provider, by default OpenAI, supports Azure, OpenAI and Anthropic - - DB_CONNECTION_STRING Database connection string - - EnableSmartFilter Whether intelligent filtering is enabled or not may affect how the AI can obtain the file directory of the repository - - UPDATE_INTERVAL Warehouse increment update interval, unit: days - - MAX_FILE_LIMIT The maximum limit for uploading files, in MB - - DEEP_RESEARCH_MODEL Conduct in-depth research on the model and use CHAT_MODEL for the empty - - ENABLE_INCREMENTAL_UPDATE Whether to enable incremental updates - - ENABLE_CODED_DEPENDENCY_ANALYSIS Whether to enable code dependency analysis,This might have an impact on the quality of the code. - - ENABLE_WAREHOUSE_FUNCTION_PROMPT_TASK # Whether to enable MCP Prompt generation or not. - - ENABLE_WAREHOUSE_DESCRIPTION_TASK # Whether to enable the generation of warehouse Description - -### Build for Different Architectures -The Makefile provides commands to build for different CPU architectures: - -```bash -# Build for ARM architecture -make build-arm - -# Build for AMD architecture -make build-amd - -# Build only backend for ARM -make build-backend-arm - -# Build only frontend for AMD -make build-frontend-amd ``` -## 👥 Contributors +## 部署选项 +- **数据库配置**：通过环境变量选择SQLite/PostgreSQL/SQL Server +- **反向代理**：提供Nginx配置示例支持前端路由与API代理 +- **Docker部署**：完整Dockerfile与docker-compose配置 -Thanks to all the developers who contributed to this project! -
- - - +## 高级特性 +- **代码依赖分析**：支持C#/Python/JavaScript等多语言解析 +- **文档版本追踪**：自动记录代码提交与文档变更日志 +- **角色权限控制**：精细的仓库级权限管理体系 +- **文件溯源系统**：每个文档片段都可追溯原始代码位置 -## Discord +## 故障排查 +- **日志查看**：`docker-compose logs` 或进入容器查看 +- **数据备份**：定期导出Markdown文档压缩包 +- **状态监控**：仓库状态码与错误信息可视化 -[join us](https://discord.gg/Y3fvpnGVwt) +## 开发者支持 +- **代码结构分析**：提供代码段依赖关系可视化 +- **API文档**：完整的RESTful接口文档与示例 +- **贡献指南**：遵循标准的开源贡献流程 -## WeChat +## 授权协议 +本项目遵循 [MIT License](LICENSE) -![Image](https://github.com/user-attachments/assets/8262bcfd-0560-44ee-81d5-d03579450149) +## 版本历史 +查看[Gitee仓库](https://gitee.com/OpenDeepWiki/KoalaWiki)的Git历史记录 -## 📄 License -This project is licensed under the MIT License - see the [LICENSE](./LICENSE) file for details. +## 技术支持 +- 📮 [Discord 社区](https://discord.gg/...) +- 💬 微信开发者群（见部署文档） -## Star History +## 项目赞助 +本项目获得 [OpenDeepWiki](https://opendeep.wiki) 开发者社区支持 -[![Star History Chart](https://api.star-history.com/svg?repos=AIDotNet/OpenDeepWiki&type=Date)](https://www.star-history.com/#AIDotNet/OpenDeepWiki&Date) +> 项目文档持续更新中，最新版本请参考中文文档 README.zh-CN.md \ No newline at end of file