5 Commits

Author SHA1 Message Date
LittleMouse bdcf6428fc Add llm-llm2 documentation and model configurations
- Introduced new documentation for the llm-llm2 framework, detailing setup, inference, linking, unlinking, pausing, exiting, and task information retrieval.
- Added model configuration files for Qwen3 series models, including Qwen3-0.6B, Qwen3-1.7B, Qwen3.5-0.8B-Int4, Qwen3.5-2B-Int4, and Qwen3.5-4B-Int4.
- Updated main.cpp to support dynamic sampling parameter overrides during inference.
- Enhanced LLMPostprocess class to handle new sampling configurations and reset to defaults.
- Updated llm_pack.py to include new model entries for packaging.
2026-04-02 16:30:56 +08:00
LittleMouse 769670147d feat: Add PaddleOCR-VL support and enhance cache handling
- Updated VLMType to include PaddleOCRVL (ID 6).
- Implemented PaddleOCRVL image processing in image_processor.cpp and header.
- Enhanced disk cache loading to guard against corrupted files and added limits on key length and block count.
- Introduced port availability check in net_utils for better error handling.
- Updated vision module to handle PaddleOCR-VL input format and normalization.
- Improved error handling during cache save operations to prevent corruption.
- Adjusted mRoPE configuration to accommodate PaddleOCR-VL.
2026-04-02 10:43:52 +08:00
LittleMouse 0fe032e4e7 [update] llm_llm2 support image input 2026-03-27 16:44:29 +08:00
LittleMouse 0e9082f032 [update] support qwen3.5 & add model file 2026-03-27 14:45:59 +08:00
LittleMouse 1ec30450d3 [update] add llm_llm2 2026-03-18 16:13:40 +08:00