Skip to content

RAG Knowledge Base Application Deployment

RAG Service Installation and Configuration

bash
# 1. Download RAG service package from documentation center
# aid-rag_1.0.0_arm64.deb
# 2. Install RAG service
dpkg -i aid-rag_1.0.0_arm64.deb
# 3. Log in with developer account
aidllm login
# 4. List available knowledge bases
aidllm remote-list rag
# 5. Pull specified knowledge base (for example tesla manual)
aidllm pull rag tesla
# 6. List downloaded local knowledge bases
aidllm list rag

Start RAG Service

bash
# Start LLM API service first (required)
aidllm start api -m Qwen2.5-VL-3B-392x392-8625
# Start RAG service with specified knowledge base
aidllm start rag -n tesla
# Verify RAG service status
aidllm status rag

Access RAG Demo

Open in browser: http://<A8625_IP>:51104/ to access the RAG chat interface and ask questions for knowledge-base-grounded answers.