Security-flagged skill
This skill may contain destructive commands. Do not install, copy, download, or run it before reviewing the skill details and source. Use it deliberately and only in contexts you understand.
Scanner findings
highscript_injection
Langsmith Evaluator
langchain-ai/skills-benchmarks/skills/main/langsmith-evaluator
codingOfficial
Official Provider SkillView repo
INVOKE THIS SKILL when building evaluation pipelines for LangSmith. Covers three core components: (1) Creating Evaluators - LLM-as-Judge, custom code; (2) Defining Run Functions - how to capture outputs and trajectories from your agent; (3) Running Evaluations - locally with evaluate() or auto-run via LangSmith. Uses the langsmith CLI tool.
Files1 files
SKILL.md429 lines
Loading editor…
Install
RecommendedOne command — your agent picks it up automatically.
Select an AI agent above to see the install command.
or
Manual Install
More stepsDownload the file and paste it into your agent's system prompt.
Skill details
Versionv1.0.0
AuthorLangChain AI
Categorycoding
Skill IDlangchain-ai/skills-benchmarks/skills/main/langsmith-evaluator
Related skills
Api DocsOpenAPI documentation and REST API design patternsDatabase MigrationsDatabase migration patterns and schema versioningDeep Agents CoreINVOKE THIS SKILL when building ANY Deep Agents application. Covers create_deep_agent(), harness architecture, SKILL.md format, and configuration options.Deep Agents MemoryINVOKE THIS SKILL when your Deep Agent needs memory, persistence, or filesystem access. Covers StateBackend (ephemeral), StoreBackend (persistent), FilesystemMiddleware, and CompositeBackend for routing.Deep Agents OrchestrationINVOKE THIS SKILL when using subagents, task planning, or human approval in Deep Agents. Covers SubAgentMiddleware, TodoList for planning, and HITL interrupts.Docker PatternsBest practices for Docker containerization and multi-stage builds