Ankur SharmaandCopybara-Service c984b9e552 feat: Add Rubric based tool use metric ...

The PR does two main things:
1) Introduces a new rubric based tool use metric
2) Given that we now have two rubric based metric, we refactor and create a new RubricBasedEvaluator interface.

PiperOrigin-RevId: 811983514

2025-09-26 15:47:42 -07:00

..

__init__.py

chore: logger = logging.getLogger(__name__) --> logger = logging.getLogger('google_adk.' + __name__)

2025-05-16 23:04:02 -07:00

_eval_set_results_manager_utils.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

_eval_sets_manager_utils.py

feat: Re-factor some eval sets manager logic, and implement GcsEvalSetsManager to handle storage of eval sets on GCS

2025-06-11 23:02:53 -07:00

agent_evaluator.py

feat: Data model for storing App Details and data model for steps

2025-09-24 18:41:38 -07:00

app_details.py

feat: Adds Rubric based final response evaluator

2025-09-24 20:30:51 -07:00

base_eval_service.py

feat: Adding implementation of evaluate method in LocalEvalService

2025-07-11 19:15:40 -07:00

common.py

feat: Add Rubric based tool use metric

2025-09-26 15:47:42 -07:00

constants.py

fix: eval module not found exception string

2025-07-24 10:23:03 -07:00

eval_case.py

feat: Adds Rubric based final response evaluator

2025-09-24 20:30:51 -07:00

eval_config.py

feat: Data model for Rubric based metric and eval config

2025-09-10 13:20:07 -07:00

eval_metrics.py

feat: Add Rubric based tool use metric

2025-09-26 15:47:42 -07:00

eval_result.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

eval_rubrics.py

feat: Data model for Rubric based metric and eval config

2025-09-10 13:20:07 -07:00

eval_set_results_manager.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

eval_set.py

chore: Batch organize imports with isort.

2025-05-21 13:23:32 -07:00

eval_sets_manager.py

fix: Update create_eval_set API to return the created EvalSet and it route

2025-08-21 17:13:46 -07:00

evaluation_constants.py

Copybara import of the project:

2025-05-02 13:59:50 -07:00

evaluation_generator.py

feat: Populate AppDetails to each Invocation

2025-09-24 22:06:56 -07:00

evaluator.py

feat: Adds Rubric based final response evaluator

2025-09-24 20:30:51 -07:00

final_response_match_v1.py

feat: Added an Fast API new endpoint to serve eval metric info

2025-07-25 16:25:20 -07:00

final_response_match_v2.py

feat: Adds Rubric based final response evaluator

2025-09-24 20:30:51 -07:00

gcs_eval_set_results_manager.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

gcs_eval_sets_manager.py

feat: Data model for storing App Details and data model for steps

2025-09-24 18:41:38 -07:00

in_memory_eval_sets_manager.py

fix: Update create_eval_set API to return the created EvalSet and it route

2025-08-21 17:13:46 -07:00

llm_as_judge_utils.py

feat: Adds Rubric based final response evaluator

2025-09-24 20:30:51 -07:00

llm_as_judge.py

feat: Add Rubric based tool use metric

2025-09-26 15:47:42 -07:00

local_eval_service.py

feat: Adds Rubric based final response evaluator

2025-09-24 20:30:51 -07:00

local_eval_set_results_manager.py

fix: add utf-8 encoding to file based reads and writes of eval data

2025-07-21 11:09:45 -07:00

local_eval_sets_manager.py

feat: Data model for storing App Details and data model for steps

2025-09-24 18:41:38 -07:00

metric_evaluator_registry.py

feat: Add Rubric based tool use metric

2025-09-26 15:47:42 -07:00

request_intercepter_plugin.py

feat: Populate AppDetails to each Invocation

2025-09-24 22:06:56 -07:00

response_evaluator.py

feat: Added an Fast API new endpoint to serve eval metric info

2025-07-25 16:25:20 -07:00

rubric_based_evaluator.py

feat: Add Rubric based tool use metric

2025-09-26 15:47:42 -07:00

rubric_based_final_response_quality_v1.py

feat: Add Rubric based tool use metric

2025-09-26 15:47:42 -07:00

rubric_based_tool_use_quality_v1.py

feat: Add Rubric based tool use metric

2025-09-26 15:47:42 -07:00

safety_evaluator.py

feat: Added an Fast API new endpoint to serve eval metric info

2025-07-25 16:25:20 -07:00

trajectory_evaluator.py

feat: Data model for storing App Details and data model for steps

2025-09-24 18:41:38 -07:00

vertex_ai_eval_facade.py

fix: Check that mean_score is a valid float value

2025-07-21 11:36:55 -07:00