Honeyhive Tools
HoneyHive は、開発者とドメインエキスパートが協力して信頼性の高い AI アプリケーションをより迅速に構築できる、モダンな AI オブザーバビリティおよび評価プラットフォームです。
AI エージェントで Honeyhive Tools を使用
Aident Loadout により、Claude Code、Codex、Cursor などの対応エージェントから Honeyhive Tools を呼び出せます。42 個の対応 Actions から選択できます。 各実行は Audit で確認できます。
Aident Vault で Honeyhive Tools に一度接続します。エージェントに認証情報を渡さずに、対応 Actions を利用できます。
カテゴリー
Integration料金と支払い
- 料金
- Loadout では無料です。個人接続のアカウントを使用する場合、プロバイダー料金が発生することがあります。
- 統合支払い
- 現在未対応です。必要な場合はプロバイダーアカウントを接続してください。
含まれる Actions
- Honeyhive Add Datapoints To DatasetTool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings.
- Honeyhive Compare RunsTool to retrieve experiment comparison between two evaluation runs. Use when you need to analyze the differences in metrics, datapoints, and events between two runs.
- Honeyhive Compare Runs EventsTool to compare events between two experiment runs side-by-side. Use when analyzing differences in model behavior, performance metrics, or outputs between evaluation runs. Returns matched event pairs with their respective data from both runs for comparison.
- Honeyhive Create Batch DatapointsTool to create multiple datapoints in a single batch operation. Use when you need to bulk-import events into a dataset or create many datapoints at once. Supports filtering by date range, event IDs, or custom criteria. Efficient for migrating large numbers of events to evaluatio…
- Honeyhive Create Batch Model EventsTool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive.
- Honeyhive Create Batch Tool EventsTool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request—use after gathering all event data.
- Honeyhive Create ConfigurationCreates a new configuration in HoneyHive for managing LLM or pipeline settings. Use this to define reusable configurations with specific models, prompts, and parameters that can be deployed across different environments (dev, staging, prod). Configurations enable version control…
- Honeyhive Create DatapointTool to create a new datapoint with input-output pairs. Use when you need to add a single datapoint with inputs, ground truth, conversation history, and metadata.
- Honeyhive Create DatasetTool to create a dataset. Use when you need to initialize a new dataset within a project.
- Honeyhive Create EventTool to create a new event in HoneyHive to track execution of different parts of your application. Use when you need to log a model call, tool execution, or chain step. Events can be grouped into sessions and nested hierarchically using parent_id and children_ids.
- Honeyhive Create MetricTool to create a new metric in HoneyHive. Use when you need to define how to evaluate model outputs, whether through code (PYTHON), AI evaluation (LLM), human review (HUMAN), or combining multiple metrics (COMPOSITE). Important: LLM metrics require both model_provider and model_…
- Honeyhive Create Model EventTool to create a new model event to log LLM call data. Use when you need to track a single model interaction including messages, responses, usage, and metadata.
- Honeyhive Create ToolCreates a new tool definition in a HoneyHive project. Use this to register functions or plugins that can be invoked and tracked within HoneyHive. Tools are defined with a JSON Schema for their parameters, allowing HoneyHive to validate inputs and track tool usage in your AI work…
- Honeyhive Delete DatapointTool to delete a specific datapoint by its ID. Use when you need to remove a datapoint from HoneyHive after confirming its identifier.
- Honeyhive Delete DatasetTool to delete a dataset by ID. Use when you need to remove a dataset after confirming its ID.
- Honeyhive End Evaluation RunTool to update an evaluation run's status and metadata. Use to mark a run as completed after finishing evaluations, or update run properties like name, metadata, configuration, and associated event/datapoint IDs.
- Honeyhive Get ConfigurationsTool to retrieve a list of configurations. Use when you need to fetch all configurations for a specific project before making changes.
- Honeyhive Get DatasetsRetrieve datasets from HoneyHive for a specified project. Use this tool when you need to: - List all datasets within a project - Find datasets by type (evaluation or fine-tuning) - Retrieve a specific dataset by its ID Returns dataset details including name, description, datapoi…
- Honeyhive Get EventsTool to query events with filters and projections from HoneyHive. Use this action when you need to retrieve events with lightweight filtering (limit 1000 results). For bulk exports or more complex queries, use the Retrieve Events action instead. Supports filtering by date range,…
- Honeyhive Get Events By Session IdTool to retrieve the complete tree of nested events for a specific session. Use when you need to analyze all events (model calls, tool calls, chains) that occurred within a session, including their hierarchical relationships, inputs, outputs, metrics, and costs. Returns a tree s…
- Honeyhive Get Events ChartTool to retrieve charting and analytics data for events over time. Use when you need aggregated metrics (duration, cost, token usage) grouped by time buckets or fields. Supports percentile analysis (p50, p95, p99) for latency monitoring and custom filters for targeted analytics.
- Honeyhive Get MetricsRetrieves all metrics associated with a HoneyHive project. Returns a list of metrics including their configuration (name, type, description, thresholds, evaluator details) and metadata (creation/update timestamps, sampling settings). Use this tool when you need to: - List all me…
- Honeyhive Get ProjectsTool to retrieve all projects in the HoneyHive account. Use when you need to list available projects, get project IDs for use in other API calls, or search for a specific project by name.
- Honeyhive Get RunTool to get details of an evaluation run by its UUID. Use when you need to check the status, configuration, results, or metadata of a specific evaluation run.
- Honeyhive Get Run MetricsTool to get event metrics for an experiment run. Use when you need to retrieve metrics computed on events within a specific experiment run. Returns an array of event objects with their associated metrics, which can be filtered by date range or custom filters.
- Honeyhive Get RunsTool to retrieve a list of evaluation runs from HoneyHive. Use when you need to: - List all evaluation runs for analysis - Find runs by status, name, or dataset - Get specific runs by their IDs - Paginate through large sets of evaluation runs Returns evaluation details including…
- Honeyhive Get Runs SchemaTool to retrieve the schema for experiment runs in HoneyHive. Use when you need to understand available fields, datasets, and mappings for experiment runs.
- Honeyhive Get SessionRetrieve a complete session tree by session ID from HoneyHive. Use this tool to fetch the full session hierarchy including all nested events (model calls, tool calls, chains) with their inputs, outputs, durations, and metadata. Returns a recursive tree structure with aggregated…
- Honeyhive List ToolsTool to list all available Honeyhive tools. Use when you need to discover which functions or plugins are registered for use.
- +13 Actions
プロバイダーのソース
関連する AI エージェント Apps
- Ably ToolsAbly は、チャットやデータ同期などのライブ機能を開発者が構築できるよう支援するリアルタイムメッセージングプラットフォームで、モダンなアプリケーションにグローバルな拡張性と高い信頼性を提供します
- Abstract ToolsAbstract API は、データ検証やデータエンリッチメントなど、開発者がさまざまなタスクを自動化するための API スイートを提供します。
- AbuseIPDB ToolsAbuseIPDB は、悪意のある活動に関連する IP アドレスを報告・確認するための一元化されたリポジトリを提供し、インターネットをより安全にすることを支援するプロジェクトです。
- Abyssale ToolsAbyssaleは、ユーザーがプログラムで画像、動画、GIF、PDF、HTML5コンテンツを生成できるクリエイティブ自動化プラットフォームで、ビジュアルコンテンツの制作を効率化します。