[update] add benchmark test

This commit is contained in:
LittleMouse
2025-04-17 09:40:23 +08:00
parent 3203fea4a0
commit 52f1a484bd
+7
View File
@@ -0,0 +1,7 @@
benchmodulellm can be used to test llm unit inference performance
Only the llm unit definition files (model json) are required.
If no model specified, it would benchmark default list. More model networks may be added later.
Usage