Preparing Your Aident Workspace...

Cas d’usageTarifs Documentation

FRCommencer maintenant

AppsDataRobot ToolsDatarobot Create Genai Evaluation Dataset Configurations

DataRobot Tools

Datarobot Create Genai Evaluation Dataset Configurations

Utilisez Datarobot Create Genai Evaluation Dataset Configurations avec DataRobot Tools via Aident Loadout. Vérifiez les entrées, sorties, la configuration, le tarif et le risque avant exécution.

Action d'écritureNiveau de risque 2 sur 5

Produit

Aident Loadout Aident Playbook Editor Open-CUAK

À propos

Apps Skills Cas d’usage Documentation Blog Tarifs Téléchargements Politique de confidentialité Conditions d'utilisation

Alternatives

vs Composio vs Zapier

llms.txtObtenir un résumé IA d’Aident

© Aident Labs, 2024-2026

Connexion par clé API

Utiliser Datarobot Create Genai Evaluation Dataset Configurations

Description du fournisseur

Tool to create a GenAI evaluation dataset configuration for testing LLM applications. Use when you need to set up evaluation datasets with prompt columns and optional response/tool call columns for assessing GenAI playground outputs. Required for running AI robustness tests on G…

Tarifs et limites

Tarif: Action gratuite
Paiement unifié: Non pris en charge actuellement

Entrées

namestring
Custom configuration name for the evaluation dataset (max 5000 characters). If omitted, DataRobot will auto-generate a name.
datasetIdstring
Obligatoire
The evaluation dataset identifier (24-character hex string). Use DATAROBOT_LIST_DATASETS to find available datasets.
useCaseIdstring
Obligatoire
The use case identifier (24-character hex string). This links the evaluation dataset to a specific use case.
playgroundIdstring
Obligatoire
The playground identifier (24-character hex string). This links the evaluation to a specific GenAI playground.
promptColumnNamestring
Obligatoire
The name of the dataset column containing prompt text. This column provides the input prompts for evaluation.
correctnessEnabledboolean
Enable legacy correctness evaluation. This flag controls whether to use DataRobot's built-in correctness metrics.
isSyntheticDatasetboolean
Indicates whether the dataset contains synthetic data (default: false). Set to true if using AI-generated evaluation data.
responseColumnNamestring
The name of the dataset column containing expected response text. Use this to compare actual LLM responses against ground truth.
toolCallsColumnNamestring
The name of the dataset column containing expected tool calls for agentic workflows. Use this for evaluating agents that call external tools.
agentGoalsColumnNamestring
The name of the dataset column containing expected agent goals for agentic workflows. Use this for evaluating multi-step agent behavior.

Sortie observable

data
Obligatoire
Data from the action execution
errorstring
Error if any occurred during the execution of the action
successfulboolean
Obligatoire
Whether or not the action execution was successful or not

Skills qui utilisent cette Action

Cas d’usage associés

Aucun cas d’usage associé et vérifié pour le moment.

Source officielle

Source du fournisseur

Skills qui utilisent cette Action

Aucune Skill publiée ne référence encore explicitement cette Action.