encounter/adk-python
0
0
Fork 0
mirror of https://github.com/encounter/adk-python.git synced 2026-07-09 18:19:28 -07:00
Code Issues Packages Projects Releases Wiki Activity
1,489 Commits 12 Branches 39 Tags
00d147d62fc9b3a2797da343d33dcd6dacd07635
Commit Graph
35 Commits
Author SHA1 Message Date
Ankur SharmaandCopybara-Service 0bd05df471 feat: Add Safety evaluator metric 
We add a new metric for evaluating safety of Agent's response to ADK Eval. We delegate the actual implementation to Vertex Gen AI Eval SDK, so using this metric will require GCP project.

As a part of this change, we created (refactored) a simple Facade for vertex gen ai eval sdk.

PiperOrigin-RevId: 778580406
 2025-07-02 11:30:31 -07:00
Ankur SharmaandCopybara-Service 62c4a85917 chore: Update ResponseEvaluator to use newer version of Eval SDK 
Also,
- removed functionality that was marked deprecated from the ResponseEvaluator class.
- Added unit test cases

PiperOrigin-RevId: 778568884
 2025-07-02 11:00:27 -07:00
Ankur SharmaandCopybara-Service b0d88bf172 feat: BaseEvalService declaration and surrounding data models 
Also, adds a metric registry.

PiperOrigin-RevId: 778186012
 2025-07-01 14:13:48 -07:00
Joseph PagadoraandCopybara-Service 9597a446fd feat: Add rouge_score library to ADK eval dependencies, and implement RougeEvaluator that is computes ROUGE-1 for "response_match_score" metric 
PiperOrigin-RevId: 774949712
 2025-06-23 15:31:03 -07:00
Google Team MemberandCopybara-Service 0a5cf45a75 feat: Implement GcsEvalSetResultsManager to handle storage of eval sets on GCS, and refactor eval set results manager 
Eval results will be stored as json files under `gs://{bucket_name}/{app_name}/evals/eval_history/`

PiperOrigin-RevId: 770499242
 2025-06-11 23:41:54 -07:00
Google Team MemberandCopybara-Service 1551bd4f4d feat: Re-factor some eval sets manager logic, and implement GcsEvalSetsManager to handle storage of eval sets on GCS 
Eval sets will be stored as json files under `gs://{bucket_name}/{app_name}/evals/eval_sets/`

PiperOrigin-RevId: 770487129
 2025-06-11 23:02:53 -07:00
Ankur SharmaandCopybara-Service 984c1d6b8b test: Added unit test coverage for local_eval_set_results_manager.py 
PiperOrigin-RevId: 767202237
 2025-06-04 10:39:09 -07:00
Ankur SharmaandCopybara-Service 174afb3975 Added unit test coverage for local_eval_sets_manager.py 
PiperOrigin-RevId: 766392263
 2025-06-03 16:54:58 -07:00
Xiang (Sean) ZhouandCopybara-Service ff8a3c9b43 chore: reformat the codes using autoformat.sh 
PiperOrigin-RevId: 762004002
 2025-05-22 09:43:54 -07:00
Google ADK Memberandhangfei 61d4be2d76 No public description 
PiperOrigin-RevId: 748777998
 2025-04-17 21:47:59 +00:00