Aident logoAident logo centerAident Loadout
Use CasesPricingDocs
ENStart Now
AppsHoneyhive ToolsHoneyhive Create Metric
Honeyhive Tools

Honeyhive Create Metric

Tool to create a new metric in HoneyHive. Use when you need to define how to evaluate model outputs, whether through code (PYTHON), AI evaluation (LLM), human review (HUMAN), or combining multiple metrics (COMPOSITE). Important: LLM metrics require both model_provider and model_…

Write actionRisk level 2 of 5API key connection
Use Honeyhive Create Metric

Pricing and limits

Aident logo

Product

Aident LoadoutAident Playbook EditorOpen-CUAK

About

AppsSkillsUse CasesDocsBlogPricingDownloadsPrivacy PolicyTerms of Service

Alternatives

vs Composiovs Zapier
llms.txtGet an AI summary of Aident LoadoutSummarize with ChatGPTSummarize with ClaudeSummarize with GeminiSummarize with Perplexity

© Aident Labs, 2024-2026

Pricing
Free
Unified payment
Not currently supported

Inputs

  • namestring
    Required
    Name of the metric. Must be unique within the project and descriptive of what is being measured.
  • typestring
    Required
    Type of metric evaluation. PYTHON: code-based, LLM: AI-evaluated, HUMAN: manually evaluated, COMPOSITE: combination of other metrics.
  • scaleinteger
    Scale for rating-type metrics (e.g., 1-5 scale, 1-10 scale)
  • filtersobject
    Filter conditions to apply before computing the metric
  • criteriastring
    Required
    Evaluation criteria that defines what this metric measures and how it should be assessed. Required for all metric types.
  • thresholdobject
    Threshold settings for determining when a metric passes or fails.
  • categoriesarray
    List of categories with scores for categorical metrics. Required when return_type is 'categorical'.
  • model_namestring
    Specific model name for LLM-evaluated metrics (e.g., 'gpt-4', 'claude-3-opus'). Required when type is LLM.
  • descriptionstring
    Detailed description of what the metric measures and when to use it
  • return_typestring
    Data type of the metric's return value
  • child_metricsarray
    List of child metrics with weights for composite metrics. Required when type is 'COMPOSITE'.
  • model_providerstring
    Model provider for LLM-evaluated metrics (e.g., 'openai', 'anthropic'). Required when type is LLM.

Observable output

  • data
    Required
    Data from the action execution
  • errorstring
    Error if any occurred during the execution of the action
  • successfulboolean
    Required
    Whether or not the action execution was successful or not

Skills that use this Action

Related use cases

No verified related use cases are linked yet.

Official source

Provider source

Skills that use this Action

No published Skills explicitly reference this Action yet.