Ankur SharmaandCopybara-Service c984b9e552 feat: Add Rubric based tool use metric ...

The PR does two main things:
1) Introduces a new rubric based tool use metric
2) Given that we now have two rubric based metric, we refactor and create a new RubricBasedEvaluator interface.

PiperOrigin-RevId: 811983514

2025-09-26 15:47:42 -07:00

..

__init__.py

No public description

2025-04-17 21:47:59 +00:00

mock_gcs_utils.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

test_app_details.py

feat: Adds Rubric based final response evaluator

2025-09-24 20:30:51 -07:00

test_eval_case.py

feat: Adds Rubric based final response evaluator

2025-09-24 20:30:51 -07:00

test_evaluation_generator.py

feat: Populate AppDetails to each Invocation

2025-09-24 22:06:56 -07:00

test_final_response_match_v1.py

feat: Added an Fast API new endpoint to serve eval metric info

2025-07-25 16:25:20 -07:00

test_final_response_match_v2.py

feat: Adds Rubric based final response evaluator

2025-09-24 20:30:51 -07:00

test_gcs_eval_set_results_manager.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

test_gcs_eval_sets_manager.py

fix: Update create_eval_set API to return the created EvalSet and it route

2025-08-21 17:13:46 -07:00

test_in_memory_eval_sets_manager.py

fix: Update create_eval_set API to return the created EvalSet and it route

2025-08-21 17:13:46 -07:00

test_llm_as_judge_utils.py

feat: Adds Rubric based final response evaluator

2025-09-24 20:30:51 -07:00

test_llm_as_judge.py

feat: Adds Rubric based final response evaluator

2025-09-24 20:30:51 -07:00

test_local_eval_service.py

feat: Data model for storing App Details and data model for steps

2025-09-24 18:41:38 -07:00

test_local_eval_set_results_manager.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

test_local_eval_sets_manager.py

fix: Update create_eval_set API to return the created EvalSet and it route

2025-08-21 17:13:46 -07:00

test_metric_evaluator_registry.py

feat: Added an Fast API new endpoint to serve eval metric info

2025-07-25 16:25:20 -07:00

test_request_intercepter_plugin.py

feat: Populate AppDetails to each Invocation

2025-09-24 22:06:56 -07:00

test_response_evaluator.py

feat: Added an Fast API new endpoint to serve eval metric info

2025-07-25 16:25:20 -07:00

test_rubric_based_evaluator.py

feat: Add Rubric based tool use metric

2025-09-26 15:47:42 -07:00

test_rubric_based_final_response_quality_v1.py

feat: Add Rubric based tool use metric

2025-09-26 15:47:42 -07:00

test_rubric_based_tool_use_quality_v1.py

feat: Add Rubric based tool use metric

2025-09-26 15:47:42 -07:00

test_safety_evaluator.py

feat: Added an Fast API new endpoint to serve eval metric info

2025-07-25 16:25:20 -07:00

test_trajectory_evaluator.py

feat: Added an Fast API new endpoint to serve eval metric info

2025-07-25 16:25:20 -07:00

test_vertex_ai_eval_facade.py

fix: Check that mean_score is a valid float value

2025-07-21 11:36:55 -07:00