Langsmith Code Eval
langchain-ai/lca-skills/skills/langsmith-code-eval
ai-mlOfficial
Official Provider SkillView repo
Creates code-based evaluators for LangSmith-traced agents. Use when building custom evaluation logic, testing tool usage patterns, or scoring agent outputs programmatically. Triggers on requests to evaluate agents, create evaluators, or run experiments against LangSmith datasets.
Files4 files
EVALUATOR_REFERENCE.md98 lines
Loading editor…
Install
RecommendedOne command — your agent picks it up automatically.
Select an AI agent above to see the install command.
or
Manual Install
More stepsDownload the archive and add the files to your project manually.
Skill details
Versionv1.0.0
AuthorLangChain AI
Categoryai-ml
Skill IDlangchain-ai/lca-skills/skills/langsmith-code-eval
Files4 files
Related skills
Langsmith FetchFetches LangSmith traces for debugging agent behavior. Use when troubleshooting agent issues, reviewing conversation history, or investigating tool calls.Configuration HardeningReview Talon tool placement and defensive prompts when requested or when adding or changing tools or subagents; apply confirmed changes and verify active capabilities.Cuml Machine LearningUse for GPU-accelerated machine learning on tabular data using NVIDIA cuML. Triggers when tasks involve classification, regression, clustering, dimensionality reduction, or model training on datasets.Deepagents Plugin DiscoveryDiscover plugins from configured dcode marketplaces when a capability is missing or the user asks about available, disabled, or not-yet-installed plugins and connected marketplaces.Deepagents Thread InspectorInspect and explain conversations in the local Deep Agents Code SQLite session store. Use to look up the current thread's title or name, as a fallback when LangSmith trace tooling is unavailable, for offline or untraced sessions, or when asked to identify or summarize a local dcode thread, inspect checkpoint metadata, list recent local threads, or parse $DEEPAGENTS_HOME/.state/sessions.db and a thread UUID or prefix.Mermaid DiagramsEmbed Mermaid diagrams in generated wiki pages. Use whenever documenting a runtime or request flow, a call sequence, a state machine or lifecycle, a data model or entity relationships, or non-trivial control flow, since these are clearer as a diagram than as prose. Also use when an update run touches a page that already contains a mermaid fence, or a page that contains a text fence a previous run degraded.