analysisOfficial
Official Provider SkillView repo
Create new eval suites for the deepagentsjs monorepo. Handles dataset design, test case scaffolding, scoring logic, vitest configuration, and LangSmith integration. Use when the user asks to: (1) create an eval, (2) write an evaluation, (3) add a benchmark, (4) build an eval suite, (5) evaluate agent behaviour, (6) add test cases for a capability, or (7) implement an existing benchmark (e.g. oolong, AgentBench, SWE-bench). Trigger on phrases like 'create eval', 'new eval', 'add eval', 'benchmark
Files1 files
SKILL.md727 lines
Loading editor…
Install
RecommendedOne command — your agent picks it up automatically.
Select an AI agent above to see the install command.
or
Manual Install
More stepsDownload the file and paste it into your agent's system prompt.
Skill details
Versionv1.0.0
AuthorLangChain AI
Categoryanalysis
Skill IDlangchain-ai/deepagentsjs/.agents/skills/eval-creator
Related skills
Arxiv SearchSearch arXiv preprint repository for papers in physics, mathematics, computer science, quantitative biology, and related fieldsFile OrganizerIntelligently organizes your files and folders across your computer by understanding context, finding duplicates, suggesting better structures, and automating cleanup tasks. Reduces cognitive load and keeps your digital workspace tidy without manual effort.Langgraph DocsUse this skill for requests related to LangGraph in order to fetch relevant documentation to provide accurate, up-to-date guidance.Langsmith TraceINVOKE THIS SKILL when working with LangSmith tracing OR querying traces. Covers adding tracing to applications and querying/exporting trace data. Uses the langsmith CLI tool.Skill CreatorGuide for creating effective skills that extend agent capabilities with specialized knowledge, workflows, or tool integrations. Use this skill when the user asks to: create a skill, make a skill, build a skill, set up a skill, initialize a skill, scaffold a skill, update or modify an existing skill, validate a skill, learn about skill structure, understand how skills work, or get guidance on skill design patterns.Web ResearchUse this skill for requests related to web research; it provides a structured approach to conducting comprehensive web research