Ankur SharmaandCopybara-Service 1355bd643b feat: Refactored AgentEvaluator and updated it to use LocalEvalService ...

With this change we ensure that all three eval entry points, web, cli and pytest use the common LocalEvalService.

Updates to web and cli happened in a previous change.

PiperOrigin-RevId: 786445632

2025-07-23 15:27:26 -07:00

..

__init__.py

chore: logger = logging.getLogger(__name__) --> logger = logging.getLogger('google_adk.' + __name__)

2025-05-16 23:04:02 -07:00

_eval_set_results_manager_utils.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

_eval_sets_manager_utils.py

feat: Re-factor some eval sets manager logic, and implement GcsEvalSetsManager to handle storage of eval sets on GCS

2025-06-11 23:02:53 -07:00

agent_evaluator.py

feat: Refactored AgentEvaluator and updated it to use LocalEvalService

2025-07-23 15:27:26 -07:00

base_eval_service.py

feat: Adding implementation of evaluate method in LocalEvalService

2025-07-11 19:15:40 -07:00

constants.py

fix: Adding detailed information on each metric evaluation

2025-06-25 18:32:02 -07:00

eval_case.py

feat: Implement auto rater-based evaluator for responses

2025-07-08 11:49:26 -07:00

eval_metrics.py

feat: Enable FinalResponseMatchV2 metric as an experiment

2025-07-17 15:59:47 -07:00

eval_result.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

eval_set_results_manager.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

eval_set.py

chore: Batch organize imports with isort.

2025-05-21 13:23:32 -07:00

eval_sets_manager.py

fix: Raise NotFoundError in list_eval_sets function when app_name doesn't exist

2025-07-17 09:53:26 -07:00

evaluation_constants.py

Copybara import of the project:

2025-05-02 13:59:50 -07:00

evaluation_generator.py

feat: Add implementation of BaseEvalService that runs evals locally

2025-07-10 19:25:24 -07:00

evaluator.py

chore: Batch organize imports with isort.

2025-05-21 13:23:32 -07:00

final_response_match_v1.py

feat: Add rouge_score library to ADK eval dependencies, and implement RougeEvaluator that is computes ROUGE-1 for "response_match_score" metric

2025-06-23 15:31:03 -07:00

final_response_match_v2.py

feat: Enable FinalResponseMatchV2 metric as an experiment

2025-07-17 15:59:47 -07:00

gcs_eval_set_results_manager.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

gcs_eval_sets_manager.py

fix: Raise NotFoundError in list_eval_sets function when app_name doesn't exist

2025-07-17 09:53:26 -07:00

in_memory_eval_sets_manager.py

feat: Implement in memory EvalSetsManager

2025-07-14 23:34:35 -07:00

llm_as_judge_utils.py

feat: Implement auto rater-based evaluator for responses

2025-07-08 11:49:26 -07:00

llm_as_judge.py

feat: Implement auto rater-based evaluator for responses

2025-07-08 11:49:26 -07:00

local_eval_service.py

feat: Refactored AgentEvaluator and updated it to use LocalEvalService

2025-07-23 15:27:26 -07:00

local_eval_set_results_manager.py

fix: add utf-8 encoding to file based reads and writes of eval data

2025-07-21 11:09:45 -07:00

local_eval_sets_manager.py

fix: add utf-8 encoding to file based reads and writes of eval data

2025-07-21 11:09:45 -07:00

metric_evaluator_registry.py

feat: Enable FinalResponseMatchV2 metric as an experiment

2025-07-17 15:59:47 -07:00

response_evaluator.py

feat: Add Safety evaluator metric

2025-07-02 11:30:31 -07:00

safety_evaluator.py

feat: Add Safety evaluator metric

2025-07-02 11:30:31 -07:00

trajectory_evaluator.py

feat: BaseEvalService declaration and surrounding data models

2025-07-01 14:13:48 -07:00

vertex_ai_eval_facade.py

fix: Check that mean_score is a valid float value

2025-07-21 11:36:55 -07:00