GenAI Consulting
Book a call
Insights

Building with Generative AI

Practical guides, architecture notes, and lessons from shipping GenAI to production.

Building a Cost-and-Latency Budget for Production RAG Systems

Building a Cost-and-Latency Budget for Production RAG Systems

A practical guide to designing production RAG systems against explicit cost and latency budgets without sacrificing quality, covering retrieval, reranking, routing, caching, async orchestration, and evals.

GenAI Consulting22 min read
Designing Evals for Multi-Step LLM Agents Before Production

Designing Evals for Multi-Step LLM Agents Before Production

A practical guide to evaluating multi-step LLM agents with planning, tools, retrieval, and memory before production, including metrics, simulators, regression suites, and release gates.

GenAI Consulting23 min read
Showing 2 of 2 articles