ai-system-quality-engineer

SKILLWorkflowcommunity
v0.0.0PramodDuttaMITUpdated 3d agoSource →

Test LLM, RAG, MCP, and agentic systems end to end. Build golden datasets, run deterministic checks and LLM judges, score retrieval, probe prompt injection, verify tool use, and gate CI on thresholds. Orchestrates DeepEval, Ragas, promptfoo, and Langfuse.

Community-submitted skill. Not yet reviewed by the Forge team. Full prompt content may not be available.Request review →
201Repo stars
1Clients
1Formats
3d agoLast update
Skill
AuthorPramodDutta
Version0.0.0
LicenseMIT
CategoryWorkflow
Formatsskill.md
PromptNot published
Compatibility
Claude✓ Supported
Cursor
Copilot
ChatGPT
Gemini
About

Test LLM, RAG, MCP, and agentic systems end to end. Build golden datasets, run deterministic checks and LLM judges, score retrieval, probe prompt injection, verify tool use, and gate CI on thresholds. Orchestrates DeepEval, Ragas, promptfoo, and Langfuse.

Keywords
skillclaude