Tool to create a test case definition for agent QA testing in Retell AI. Use when you need to define test scenarios for evaluating agent performance with specific user personas, goals, and success metrics.
nameRequiredstringName of the test case definition.
metricsRequiredarrayArray of metric name strings to evaluate the test case. Each metric describes a specific aspect to verify.
llm_modelstringOptional LLM model specification to use for evaluation.
tool_mocksarrayOptional array of tool mocks to simulate tool responses during testing.
user_promptRequiredstringUser scenario prompt describing the identity, goal, and personality for the test case. Should outline who the user is, what they want to achieve, and how they behave.
response_engineRequiredobjectResponse engine configuration. Must include type ('retell-llm' or 'conversation-flow'), the corresponding ID field, and version.
dynamic_variablesobjectOptional dynamic variables object to inject into the test case prompts as key-value pairs.
dataRequiredData from the action execution
errorstringError if any occurred during the execution of the action
successfulRequiredbooleanWhether or not the action execution was successful or not
API key connection. Risk level 2 of 5.
Free Action
No published Skills explicitly reference this Action yet.