diff --git a/benchmark/README.md b/benchmark/README.md new file mode 100644 index 0000000..f32dcdb --- /dev/null +++ b/benchmark/README.md @@ -0,0 +1,7 @@ +benchmodulellm can be used to test llm unit inference performance + +Only the llm unit definition files (model json) are required. + +If no model specified, it would benchmark default list. More model networks may be added later. + +Usage \ No newline at end of file