feat: Add Rubric based tool use metric

Browse Source

The PR does two main things:
1) Introduces a new rubric based tool use metric
2) Given that we now have two rubric based metric, we refactor and create a new RubricBasedEvaluator interface.

PiperOrigin-RevId: 811983514

...

This commit is contained in:

Ankur Sharma

2025-09-26 15:47:42 -07:00

committed by Copybara-Service

parent a959653cf3

commit c984b9e552

10 changed files with 1312 additions and 681 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

tests/unittests/evaluation/test_rubric_based_evaluator.py

+554

File diff suppressed because it is too large Load Diff