LittleMouse bdcf6428fc Add llm-llm2 documentation and model configurations ...

- Introduced new documentation for the llm-llm2 framework, detailing setup, inference, linking, unlinking, pausing, exiting, and task information retrieval.
- Added model configuration files for Qwen3 series models, including Qwen3-0.6B, Qwen3-1.7B, Qwen3.5-0.8B-Int4, Qwen3.5-2B-Int4, and Qwen3.5-4B-Int4.
- Updated main.cpp to support dynamic sampling parameter overrides during inference.
- Enhanced LLMPostprocess class to handle new sampling configurations and reset to defaults.
- Updated llm_pack.py to include new model entries for packaging.

2026-04-02 16:30:56 +08:00

..

mode_Qwen3-0.6B-ax650.json

Add llm-llm2 documentation and model configurations

2026-04-02 16:30:56 +08:00

mode_Qwen3-1.7B-ax650.json

Add llm-llm2 documentation and model configurations

2026-04-02 16:30:56 +08:00

mode_Qwen3.5-0.8B-ax650.json

Add llm-llm2 documentation and model configurations

2026-04-02 16:30:56 +08:00

mode_Qwen3.5-0.8B-Int4-ax650.json

Add llm-llm2 documentation and model configurations

2026-04-02 16:30:56 +08:00

mode_Qwen3.5-2B-ax650.json

[update] support qwen3.5 & add model file

2026-03-27 14:45:59 +08:00

mode_Qwen3.5-2B-Int4-ax650.json

Add llm-llm2 documentation and model configurations

2026-04-02 16:30:56 +08:00

mode_Qwen3.5-4B-Int4-ax650.json

Add llm-llm2 documentation and model configurations

2026-04-02 16:30:56 +08:00