RAG Knowledge Base Application Deployment

RAG Service Installation & Configuration

# Online installation of RAG service; password: aidlux
sudo aidllm install rag
# Log in with your developer account
aidllm login
# View available knowledge bases
aidllm remote-list rag
# Download a specific knowledge base (e.g., Tesla user manual)
aidllm pull rag tesla
# View locally downloaded knowledge bases
aidllm list rag

Starting the RAG Service

# Start the LLM API service (must be started first). Skip this step if already running.
aidllm start api -m qwen2.5-vl-3b-instruct-392x392-qnn2.36-w4a16-qcs8550
# Start the RAG service and specify the knowledge base
aidllm start rag -n tesla
# Verify RAG service status
aidllm status rag

Starting the UI Service

# Download the UI; password: aidlux
sudo aidllm install ui
# Start the UI
aidllm start ui
# Verify UI service status
aidllm status ui

Accessing the RAG Demo

Enter http://<A8550MA1_IP>:51104/ in your browser to access the RAG chat interface. Enter questions to receive precise answers based on the knowledge base.