Xiang (Sean) ZhouandCopybara-Service c5b976b306 chore: Create the context cache based on the token count of previous request ...

before this change, we estimate the token count of the contents to cache and use it to compare with the threshold user set. but that's not precise , so we use the actual prompt token count of previous llm request.

We won't create cache for the very initial request

PiperOrigin-RevId: 814484840

2025-10-02 19:22:00 -07:00

..

integration

chore: Update AgentEvaluator to use EvalConfig

2025-10-02 13:43:44 -07:00

unittests

chore: Create the context cache based on the token count of previous request

2025-10-02 19:22:00 -07:00

__init__.py

Support async agent and model callbacks

2025-05-06 15:14:10 -07:00