encounter/adk-python
0
0
Fork 0
mirror of https://github.com/encounter/adk-python.git synced 2026-07-09 18:19:28 -07:00
Code Issues Packages Projects Releases Wiki Activity
768 Commits 12 Branches 39 Tags
94b5aaf0a1c2bba8a3b80b26a1eb09f35099c488
Commit Graph
14 Commits
Author SHA1 Message Date
Ankur SharmaandCopybara-Service bab3be2cf3 feat: Add support for persisting eval run results 
If the EvalRunResultsManager is provided to LocalEvalService, then we want to persist the eval run results using it.

PiperOrigin-RevId: 782196848
 2025-07-11 19:29:32 -07:00
Ankur SharmaandCopybara-Service 33eec34577 feat: Adding implementation of evaluate method in LocalEvalService 
Also, delete agent_creator.py file. We added this file by mistake.

PiperOrigin-RevId: 782193593
 2025-07-11 19:15:40 -07:00
Ankur SharmaandCopybara-Service 51be7a899c feat: Add implementation of BaseEvalService that runs evals locally 
This change:
- Introduces the LocalEvalService Class.
- Implements only the "perform_inference" method. Evaluate method will be implemented in the next CL.
- Adds required test coverage.

PiperOrigin-RevId: 781781954
 2025-07-10 19:25:24 -07:00
Joseph PagadoraandCopybara-Service 75699fbeca feat: Implement auto rater-based evaluator for responses 
PiperOrigin-RevId: 780654576
 2025-07-08 11:49:26 -07:00
Ankur SharmaandCopybara-Service 0bd05df471 feat: Add Safety evaluator metric 
We add a new metric for evaluating safety of Agent's response to ADK Eval. We delegate the actual implementation to Vertex Gen AI Eval SDK, so using this metric will require GCP project.

As a part of this change, we created (refactored) a simple Facade for vertex gen ai eval sdk.

PiperOrigin-RevId: 778580406
 2025-07-02 11:30:31 -07:00
Ankur SharmaandCopybara-Service 62c4a85917 chore: Update ResponseEvaluator to use newer version of Eval SDK 
Also,
- removed functionality that was marked deprecated from the ResponseEvaluator class.
- Added unit test cases

PiperOrigin-RevId: 778568884
 2025-07-02 11:00:27 -07:00
Ankur SharmaandCopybara-Service b0d88bf172 feat: BaseEvalService declaration and surrounding data models 
Also, adds a metric registry.

PiperOrigin-RevId: 778186012
 2025-07-01 14:13:48 -07:00
Joseph PagadoraandCopybara-Service 9597a446fd feat: Add rouge_score library to ADK eval dependencies, and implement RougeEvaluator that is computes ROUGE-1 for "response_match_score" metric 
PiperOrigin-RevId: 774949712
 2025-06-23 15:31:03 -07:00
Google Team MemberandCopybara-Service 0a5cf45a75 feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager 
Eval results will be stored as json files under `gs://{bucket_name}/{app_name}/evals/eval_history/`

PiperOrigin-RevId: 770499242
 2025-06-11 23:41:54 -07:00
Google Team MemberandCopybara-Service 1551bd4f4d feat: Re-factor some eval sets manager logic, and implement GcsEvalSetsManager to handle storage of eval sets on GCS 
Eval sets will be stored as json files under `gs://{bucket_name}/{app_name}/evals/eval_sets/`

PiperOrigin-RevId: 770487129
 2025-06-11 23:02:53 -07:00
Ankur SharmaandCopybara-Service 984c1d6b8b test: Added unit test coverage for local_eval_set_results_manager.py 
PiperOrigin-RevId: 767202237
 2025-06-04 10:39:09 -07:00
Ankur SharmaandCopybara-Service 174afb3975 Added unit test coverage for local_eval_sets_manager.py 
PiperOrigin-RevId: 766392263
 2025-06-03 16:54:58 -07:00
Xiang (Sean) ZhouandCopybara-Service ff8a3c9b43 chore: reformat the codes using autoformat.sh 
PiperOrigin-RevId: 762004002
 2025-05-22 09:43:54 -07:00
Google ADK Memberandhangfei 61d4be2d76 No public description 
PiperOrigin-RevId: 748777998
 2025-04-17 21:47:59 +00:00