Ankur SharmaandCopybara-Service 51be7a899c feat: Add implementation of BaseEvalService that runs evals locally ...

This change:
- Introduces the LocalEvalService Class.
- Implements only the "perform_inference" method. Evaluate method will be implemented in the next CL.
- Adds required test coverage.

PiperOrigin-RevId: 781781954

2025-07-10 19:25:24 -07:00

..

__init__.py

No public description

2025-04-17 21:47:59 +00:00

mock_gcs_utils.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

test_final_response_match_v1.py

feat: Add rouge_score library to ADK eval dependencies, and implement RougeEvaluator that is computes ROUGE-1 for "response_match_score" metric

2025-06-23 15:31:03 -07:00

test_final_response_match_v2.py

feat: Implement auto rater-based evaluator for responses

2025-07-08 11:49:26 -07:00

test_gcs_eval_set_results_manager.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

test_gcs_eval_sets_manager.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

test_llm_as_judge.py

feat: Implement auto rater-based evaluator for responses

2025-07-08 11:49:26 -07:00

test_local_eval_service.py

feat: Add implementation of BaseEvalService that runs evals locally

2025-07-10 19:25:24 -07:00

test_local_eval_set_results_manager.py

feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager

2025-06-11 23:41:54 -07:00

test_local_eval_sets_manager.py

feat: Re-factor some eval sets manager logic, and implement GcsEvalSetsManager to handle storage of eval sets on GCS

2025-06-11 23:02:53 -07:00

test_metric_evaluator_registry.py

feat: BaseEvalService declaration and surrounding data models

2025-07-01 14:13:48 -07:00

test_response_evaluator.py

feat: Add Safety evaluator metric

2025-07-02 11:30:31 -07:00

test_safety_evaluator.py

feat: Add Safety evaluator metric

2025-07-02 11:30:31 -07:00

test_trajectory_evaluator.py

chore: reformat the codes using autoformat.sh

2025-05-22 09:43:54 -07:00

test_vertex_ai_eval_facade.py

feat: Add Safety evaluator metric

2025-07-02 11:30:31 -07:00