feat: support context caching

Browse Source

1. add a context cache config in app level which will apply to all agents in the app
2. pass on cache config through invocation context to llm_reqeust
3. store cache metadata in llm_response
4. lookup old cache metadata from latest event for reusing old cache
5. create new cache if old cache cannot be reused

PiperOrigin-RevId: 809158578

...

This commit is contained in:

Xiang (Sean) Zhou

2025-09-19 13:17:02 -07:00

committed by Copybara-Service

parent 13a95c463d

commit c66245a3b8

20 changed files with 3234 additions and 7 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

tests/unittests/agents/test_gemini_context_cache_manager.py

+523

File diff suppressed because it is too large Load Diff