Run Source Model Baseline
awslabs/startups/migrate/plugins/ai-to-aws/skills/run-source-model-baseline
ai-mlOfficial
Official Provider SkillView repo
Re-run a JSONL of golden prompts against the live source LLM provider (OpenAI, Anthropic, or Gemini) on the local host and write per-prompt responses to <repo>/.saws-migrate/eval-results/source_baselines.jsonl. Load this from ai-prompt-evaluator §9 when source_baseline_available == true and same_model_family == false; the produced JSONL gives the evaluator real source-vs-Bedrock side-by-side outputs instead of comparing Bedrock against agent-synthesized baselines.
Files1 files
SKILL.md1 lines
Loading editor…
Install
RecommendedOne command — your agent picks it up automatically.
Select an AI agent above to see the install command.
or
Manual Install
More stepsDownload the file and paste it into your agent's system prompt.
Skill details
Versionv1.0.0
AuthorAWS Labs
Categoryai-ml
Skill IDawslabs/startups/migrate/plugins/ai-to-aws/skills/run-source-model-baseline
Related skills
AgentcoreDeep-dive into Amazon Bedrock AgentCore platform design, service selection, deployment, and production operations. This skill should be used when the user asks to "design an AgentCore architecture", "deploy agents on AgentCore", "configure AgentCore Runtime", "set up AgentCore Memory", "use AgentCore Gateway", "configure AgentCore Identity", "set up AgentCore Policy", "plan agent observability", "evaluate agent quality", "move agent PoC to production", or mentions AgentCore, AgentCore Runtime, AApi GatewayDesign and configure Amazon API Gateway APIs. Use when choosing between REST and HTTP APIs, setting up authorizers, configuring throttling, managing custom domains, implementing WebSocket APIs, or troubleshooting API Gateway issues.Architect For StartupsAWS architecture advisor tailored specifically for startups. Alters AWS architecture recommendations based on startup stage (pre-revenue through Series B+), team size, runway, and credits. ALWAYS use when asked about building on AWS, choosing services, planning infrastructure, managing costs with credits, or preparing architecture for fundraising.Aws ArchitectDesign and review AWS architectures following Well-Architected Framework principles. Use when planning new infrastructure, reviewing existing architectures, evaluating trade-offs between AWS services, or when asked about AWS best practices.Aws CompareCompare 2-3 AWS architecture options side-by-side across cost, complexity, performance, security, and operational burden. Use when evaluating trade-offs between approaches or when the user is deciding between options.Aws DebugDebug AWS infrastructure issues, deployment failures, and runtime errors. Use when troubleshooting CloudFormation stack failures, Lambda errors, ECS task failures, permission issues, networking problems, or any AWS service misbehavior.