3 Commits

Include renames

Author	SHA1	Message	Date
Google Team MemberandCopybara-Service	aeaec859bf	feat: Adds Static User Simulator and User Simulator Provider ... Details: - Adds the `StaticUserSimulator` which implements the current functionality of supplying a fixed set of user prompts for an EvalCase. - Adds the `UserSimulatorProvider` which determines the type of user simulator required for an EvalCase (StaticUserSimulator or LlmBackedUserSimulator). - Integrates the UserSimulatorProvider and UserSimulator into the CLI and evaluation infrastructure. - Updates and adds unit tests for the new functionality. - Miscellaneous updates to lay groundwork for a full implementation of the LlmBackedUserSimulator in the future. PiperOrigin-RevId: 822198401	2025-10-21 11:15:11 -07:00
Ankur SharmaandCopybara-Service	5a485b01cd	feat: Adds Rubric based final response evaluator ... The evaluator uses a set of rubrics to assess the quality of the agent's final response. PiperOrigin-RevId: 811154498	2025-09-24 20:30:51 -07:00
Ankur SharmaandCopybara-Service	01923a9227	feat: Data model for storing App Details and data model for steps ... Details: 1. Data model for storing App Details (the agentic system) As we move towards LLM as Judge metrics, we see that some of these metrics need information about the Agentic system that was used for inferencing. We add a data model to capture that. 2. Data model for Steps We refine the concept of intermediate data. Previously it stored data in the form of a multiple lists, thereby losing out on the chronological information. This information is needed for some of the metrics. So we refine the concept of intermediate data as series of logical steps that an Agent Take. PiperOrigin-RevId: 811122784	2025-09-24 18:41:38 -07:00