Multi-model rating for AI evaluation: measures agreement among model raters (Fleiss' κ, Kendall's W) to find contested items for expert review. Agreement is reliability, not validity. Maintenance mode.
Inferred from the transports this listing declares (stdio). A client not listed here hasn’t been ruled out — it just isn’t something Forge can confirm.
Verification confirms publisher identity (repo ownership), not code safety. The security scan covers known CVEs and suspicious install scripts.
Read out of the source npm actually ships, at scan time. The package was never executed. Tools registered dynamically at runtime, or hidden inside bundled or minified code, can be missed — so this is a floor on the tool surface, not a complete census of it.
conkurrence_bedrock_healthTest Bedrock model accessibility. Probes each model with a minimal invocation to verify IAM permissions and model enablement. Reports which models are accessible in the configured region.Test Bedrock model accessibility. Probes each model with a minimal invocation to verify IAM permissions and model enablement. Reports which models are accessible in the configured region.
No input schema was published for this tool.
conkurrence_compareCompare two Conkurrence runs side-by-side. Shows κ deltas, per-field changes, classification shifts, and cost differences. Provide run_ids or inline results.Compare two Conkurrence runs side-by-side. Shows κ deltas, per-field changes, classification shifts, and cost differences. Provide run_ids or inline results.
No input schema was published for this tool.
conkurrence_estimateEstimate the cost and token usage for a Conkurrence evaluation run before executing it.Estimate the cost and token usage for a Conkurrence evaluation run before executing it.
No input schema was published for this tool.
conkurrence_licenseManage your ConKurrence license. Actions: "validate" checks a license key against the API, "activate" stores a key for this MCP session, "status" shows current license state (free runs remaining or active key info).Manage your ConKurrence license. Actions: "validate" checks a license key against the API, "activate" stores a key for this MCP session, "status" shows current license state (free runs remaining or active key info).
No input schema was published for this tool.
conkurrence_list_runsList all Conkurrence runs stored in the current session. Shows run_id, schema name, timestamp, overall kappa, item count, and cost for each run. Use run_ids with other tools (compare, trend, report).List all Conkurrence runs stored in the current session. Shows run_id, schema name, timestamp, overall kappa, item count, and cost for each run. Use run_ids with other tools (compare, trend, report).
No input schema was published for this tool.
conkurrence_providersCheck which AI provider API keys are configured. Reports availability of Bedrock (AWS credential chain), OpenAI (OPENAI_API_KEY), Gemini (GOOGLE_API_KEY or GEMINI_API_KEY), and MCP Sampling (host model). Also documents the model prefix convention.Check which AI provider API keys are configured. Reports availability of Bedrock (AWS credential chain), OpenAI (OPENAI_API_KEY), Gemini (GOOGLE_API_KEY or GEMINI_API_KEY), and MCP Sampling (host model). Also documents the model prefix convention.
No input schema was published for this tool.
conkurrence_reportGenerate a detailed markdown report from Conkurrence results. Provide either a run_id (from a previous conkurrence_run) or inline results.Generate a detailed markdown report from Conkurrence results. Provide either a run_id (from a previous conkurrence_run) or inline results.
No input schema was published for this tool.
conkurrence_runExecute a Conkurrence evaluation. If multiple model providers are configured, measures inter-rater consensus across models (Fleiss κ). If no API credentials are available, automatically uses the host model for a self-consistency check (5 runs by default). Returns a summary with run_id — full result…Execute a Conkurrence evaluation. If multiple model providers are configured, measures inter-rater consensus across models (Fleiss κ). If no API credentials are available, automatically uses the host model for a self-consistency check (5 runs by default). Returns a summary with run_id — full result…
No input schema was published for this tool.
conkurrence_suggestAnalyze sample items and suggest an evaluation schema. Returns field suggestions with reliability estimates. Use before creating a schema to get AI-guided field design. Supports multi-provider models: Bedrock (default), OpenAI ("openai." prefix), Gemini ("gemini." prefix). If no API credentials are…Analyze sample items and suggest an evaluation schema. Returns field suggestions with reliability estimates. Use before creating a schema to get AI-guided field design. Supports multi-provider models: Bedrock (default), OpenAI ("openai." prefix), Gemini ("gemini." prefix). If no API credentials are…
No input schema was published for this tool.
conkurrence_templatesList available evaluation templates or get the full contents of a specific template. Templates include schema, sample data, and config files.List available evaluation templates or get the full contents of a specific template. Templates include schema, sample data, and config files.
No input schema was published for this tool.
conkurrence_trendAnalyze trends across multiple Conkurrence runs. Shows overall and per-field kappa progression, degradation alerts, schema evolution, and classification distribution over time. Provide run_ids or inline results. Requires 2+ runs.Analyze trends across multiple Conkurrence runs. Shows overall and per-field kappa progression, degradation alerts, schema evolution, and classification distribution over time. Provide run_ids or inline results. Requires 2+ runs.
No input schema was published for this tool.
conkurrence_validate_schemaValidate an evaluation schema for use with Conkurrence. Returns validation results including any errors or warnings.Validate an evaluation schema for use with Conkurrence. Returns validation results including any errors or warnings.
No input schema was published for this tool.
12 of 12 tools published a description.
Tool names and descriptions are written by the publisher and shown verbatim as inert text. They are the strings an MCP client passes to a model, so Forge scans them for prompt-injection patterns — any finding appears with the security scan above. “Privileged” is a keyword match on the tool name, not an audit of what the tool does: a benign-sounding name can still do anything.
Multi-model rating for AI evaluation: measures agreement among model raters (Fleiss' κ, Kendall's W) to find contested items for expert review. Agreement is reliability, not validity. Maintenance mode.
Linked names open Forge’s index of every entry observed exposing that tool. Browse all indexed tools.
The crawl stopped at the 60-package limit. The rest of the tree was never resolved.
36 more resolved packages are not drawn here (display cap: 24). Every dependency carrying an advisory is drawn regardless of the cap. Full inventory (CycloneDX SBOM)
124 declared dependencies never landed in the tree. They are missing from Forge's resolution, not from the package.
+112 more not listed. The counts by reason above cover all of them.
Not followed: peerDependencies. This tree covers runtime dependencies only, so anything those pull in was never resolved.