59 Commits

Author SHA1 Message Date
Abandon-ht 5f71dc2f2d Merge pull request #6 from roadriverrail/fix_chat_stream
llm_client_backend: add object type to completion marker
2026-02-24 09:32:58 +08:00
Kit Rhett Aultman 6e8b3d9e8e llm_client_backend: add object type to completion marker
The OpenAI chat completion API shows that streaming chat completion
chunks should have the object type "chat.completion.chunk" in the
completion marker chunk.  Without this, some parsers of the OpenAI API
don't handle chat completion streaming responses from this server.

This commit fixes the lack of an object type, keeps compliance with the
described API in the OpenAI docs (see
https://platform.openai.com/docs/api-reference/chat/create), and ensures
parsers like the Home Assistant HomeLLM addon work with it.
2026-01-18 14:09:58 -05:00
Abandon-ht 9612b20800 Merge pull request #5 from m5stack/dev
[feat] The tts backend supports model switching.
2025-04-23 14:48:04 +08:00
LittleMouse 6dd2b784f7 [feat] The tts backend supports model switching. 2025-04-23 14:47:10 +08:00
Abandon-ht 9d4a2d0e8a Merge pull request #4 from m5stack/dev
[perf]  Optimize contextual conversations
2025-04-23 14:11:29 +08:00
LittleMouse d5a2dc4755 [perf] Optimize contextual conversations 2025-04-23 12:25:31 +08:00
Abandon-ht 6f783440eb Merge pull request #3 from m5stack/dev
[fix] Fix language parameter passing
2025-04-21 12:25:02 +08:00
LittleMouse bfbc3f5414 [fix] Fix language parameter passing 2025-04-17 18:28:17 +08:00
LittleMouse 33477071ca [feat] The asr backend supports model switching. 2025-04-16 19:24:31 +08:00
Abandon-ht 3e211eb377 Merge pull request #2 from nnn112358/dev
Fixes in  README.md,requirements.txt
2025-04-16 10:37:17 +08:00
nnn 9a02830bde Update README.md 2025-04-16 11:33:20 +09:00
nnn 79251a6a3b Update README.md 2025-04-16 11:21:00 +09:00
nnn 98f7076e53 Update README.md 2025-04-16 10:51:33 +09:00
nnn d181ce51f2 Update requirements.txt 2025-04-16 10:51:15 +09:00
LittleMouse cb13b0acea [fix] Fix wrong fields 2025-04-15 19:38:36 +08:00
LittleMouse c0bcfd4d4b [perf] Add audio segmentation and transcoding 2025-04-15 16:36:40 +08:00
LittleMouse 0bf4767ff0 [chore] Delete log printing 2025-04-15 14:10:09 +08:00
LittleMouse f860eb74be [perf] Increase chunk_size and add sending interval 2025-04-15 10:35:09 +08:00
LittleMouse fe73b135c7 [perf] Audio base64 data is sent using streaming 2025-04-14 17:59:03 +08:00
LittleMouse d54df28357 [refactor] Refactor tts_client_backend 2025-04-14 14:16:27 +08:00
LittleMouse 46e0ecf3b2 [refactor] Refactor asr_client_backend 2025-04-14 11:03:56 +08:00
LittleMouse b7fa5ad767 [fix] Fixed multiple exit issues 2025-04-11 18:01:40 +08:00
LittleMouse 21ab7c7ac7 [fix] Optimize the llm model switching method and fix the instance exit problem 2025-04-11 17:25:56 +08:00
LittleMouse 8651a0f39b [fix] Fix client pool lock.Optimization task paused 2025-04-11 11:18:14 +08:00
LittleMouse 538b219c48 [perf] Optimize different model loading methods 2025-04-09 19:46:43 +08:00