/ai--chatbot-scaffold

Implements vector embeddings in your app for semantic search, RAG or similarity matching: ingestion, chunking, querying and relevance tuning.

Builds a test harness that measures a RAG pipeline: a golden question set, retrieval metrics, groundedness checks and a regression gate.

Adds input and output filters, prompt-injection defense and personal-data handling around an AI feature, then proves them with adversarial tests.

Audits what goes into your AI app's context window and decides what to retrieve, summarize or compact, then checks the result with an eval.

Decides honestly whether an LLM needs fine-tuning or better prompts, and if so prepares data, trains and compares before and after on held-out data.

Measures where your app spends tokens, then applies model routing, caching and prompt compression, keeping each change only if an eval shows quality holds.

Sets up an evaluation suite for an AI feature: test cases, rubrics, code-based checks, LLM-as-judge with bias controls and a CI gate.

Instruments your AI app with traces, token and cost tracking, quality signals, dashboards and alerts for every model call.

Builds a Model Context Protocol server that exposes your project's functions, APIs or data to clients like Claude Code, with transport, auth and tests.