benchmark/README.md

benchmodulellm can be used to test llm unit inference performance

Only the llm unit definition files (model json) are required.

If no model specified, it would benchmark default list. More model networks may be added later.

Usage
```shell
python benchmodulellm.py --host 192.168.20.100 --port 10001 --test-items default.yaml
```
[update] add benchmark test 2025-04-17 09:40:23 +08:00			`benchmodulellm can be used to test llm unit inference performance`

			`Only the llm unit definition files (model json) are required.`

			`If no model specified, it would benchmark default list. More model networks may be added later.`

[update] add llm unit test. 2025-04-17 17:36:35 +08:00			`Usage`
			```shell
			`python benchmodulellm.py --host 192.168.20.100 --port 10001 --test-items default.yaml`
			```