From da92e88ad31cedf0cd116a75a7117be7abf19224 Mon Sep 17 00:00:00 2001 From: LittleMouse Date: Wed, 23 Apr 2025 19:21:02 +0800 Subject: [PATCH] [update] Add Chatbox Doc --- client/Chatbox.md | 34 ++++++++++++++++++++++++++++++++++ 1 file changed, 34 insertions(+) create mode 100644 client/Chatbox.md diff --git a/client/Chatbox.md b/client/Chatbox.md new file mode 100644 index 0000000..6de1de9 --- /dev/null +++ b/client/Chatbox.md @@ -0,0 +1,34 @@ +# Update ModuleLLM's package +1. Get the IP address of ModuleLLM via ADB or Serial. +2. ssh connection to ModuleLLM +3. `apt update` Get the latest packages +4. `apt list | grep lib-llm` Get the ModuleLLM base package +5. `apt install lib-llm` Update ModuleLLM base package +6. `apt list | grep llm-` Get the ModuleLLM package +7. `apt install llm-sys llm-llm llm-vlm llm-whisper llm-melotts` Update Module LLM Package +8. `apt list | grep llm-model-` Get the ModuleLLM model package +9. `apt install qwen2.5-0.5b-p256-ax630c` Install the large language model package +10. `apt install whisper-tiny` Install the speech transcription model package +11. `apt install melotts-en-us` Install the speech synthesis model package +12. `reboot` Restart ModuleLLM + +# How to use Chatbox to interact with ModuleLLM +## Download the corresponding platform from the Chatbox official website [Click to jump](https://chatboxai.app/en) + + +![本地图片](../images/01-chatbox.png "本地图片") + +## Click Settings and add Model Provier +![本地图片](../images/02-chatbox.png "本地图片") + +## API Host is set to `http://192.168.20.186:8000/v1`, Note that IP is your ModuleLLM IP, API Path is set to `/chat/completions` +![本地图片](../images/03-chatbox.png "本地图片") + +## Turn off Inject default metadata under the CHAT tab +![本地图片](../images/04-chatbox.png "本地图片") + +## Note that the length of the input text cannot exceed the maximum length supported by the model +![本地图片](../images/05-chatbox.png "本地图片") + +## Click the red box to stop generating. +![本地图片](../images/06-chatbox.png "本地图片") \ No newline at end of file