Ishaan Chaturvedi
AI Engineer · Production LLM & Agentic Systems
London, UK · [email protected] · LinkedIn · GitHub
- 7+years production ML & AI
- 178merged PRs, agent-built, solo
- 4×T4s: self-hosted LLM stack, GDPR
- 15AI use cases surfaced, company-wide
- 5/8acquisitions at ~98% of projected value
Profile
AI Engineer specialising in production LLM and agentic systems, with 7+ years across enterprise machine learning and independent product building. I design, ship, and evaluate end-to-end AI inside regulated financial environments (self-hosted LLM deployment under GDPR, document-intelligence and agentic pipelines, enterprise-wide AI use-case discovery), focused on the parts that decide whether AI products survive production: evaluation, observability, structured outputs, and cost control. Independently, I architect and operate Alter, a self-hosted production AI product, and the multi-agent harness that builds it: 178 merged PRs across 14 phases in nine months, most of the code agent-written under independent verification. I also build Spiral, a multi-agent AI filmmaking tool: seven agent departments over an event log.
Experience
- Selected onto PRA’s cross-organisation AI Tiger Team (reporting to an SVP) to identify and ship LLM and agentic AI use cases across US and international operations on an Azure stack: Azure AI Foundry, Microsoft Fabric, Google ADK.
- Lead engineer and architect of two production agentic systems for the US business: a Disputes & Complaints investigation system (built end to end, in testing) and a Custodian of Records pre-legal document-validation system (nearly complete), each reading scanned correspondence and legal documents with GPT vision, reconciling them against the system of record, and producing cited, evidenced findings for frontline review.
- Designed the shared verification platform both run on: typed Pydantic contracts, generic presence / doc-type / extraction / reconcile sub-agents, a registry-driven read-only SQL allow-list data layer, tiered vision-first document reading with Document Intelligence fallback, Managed Identity throughout, and a merge-blocking evaluation and AI-safety harness (golden sets, near-zero false-accept floors, injection / hallucination / guardrail suites).
- Owned the north-star specifications and a results-first delivery plan (two-week iterations, each closing on a measured scorecard) under one rule: LLMs extract, deterministic code decides; every compliance-weight rule in versioned config, every conclusion cited.
- Deployed a self-hosted, multi-model LLM stack on 4× NVIDIA Tesla T4 GPUs to keep regulated data in-environment under GDPR, routing to purpose-specific models (fine-tuned Mistral for summarisation, DeepSeek-R1-Distill-Qwen for reasoning).
- Led a company-wide AI discovery initiative across every department, surfacing 15 high-value use cases, each quantified with effort–value scoring; built LLM + OCR pipelines over court documents (tiered legal failure-reason taxonomy) and foreign-language seller files, and agentic pipelines for affluence detection and customer-journey summarisation.
- Portfolio valuation & forecasting: end-to-end pricing of non-performing loan portfolios (KNN peer selection, pay-curve generation, calibrated recovery models), supporting 5 of 8 acquisitions now performing at ~98% of projected value.
- Monte Carlo simulation: state-based simulation with a classifier for account-state transitions and a regressor for payment amounts; benchmarked XGBoost, Random Forest, and a Time-Series Transformer.
- Collections decision science: WoE scorecards (avg AUC-ROC 0.74), 8 hierarchical customer clusters, optimised dialler contact limits.
- Built near-real-time anomaly-detection models for a privileged-access-management product.
- Developed an online hierarchical-clustering system for user-behaviour analytics.
- Led a two-person team to ship fraud-detection analytics tooling, later adopted across the product suite.
Selected Projects
- Self-hosted, live, paid AI product on an 11-service TypeScript / NestJS architecture (~289K LOC, ~40% tests); a two-stage LLM recognition layer classifies each input into a typed plan, files it autonomously, and auto-compiles a per-user knowledge base with hybrid search.
- Agentic decision layer: migrated hand-written routing rules to model-owned decisions inside a deterministic spine (queues, budgets, gates, receipts unchanged); autonomy bounded by reversibility: autonomous filing, propose-only structural change.
- Agentic workflows: multi-step plans with automatic re-grounding, branching, and end-of-thread synthesis.
- Evals: golden eval suites as CLI runners with per-run cost budgets; prompts as tested, versioned components.
- Multi-provider + structured output: Anthropic / OpenAI / Google / Perplexity abstraction with complexity-based cost routing, prompt caching, and strict tool-use + Zod schemas with retry-repair.
- RAG: pgvector-backed hybrid (semantic + keyword) search over an event-driven reindex pipeline.
- Production-grade: encryption-by-default, CI-enforced privacy invariants, per-user cost caps and entitlement gates, 6-hourly encrypted backups with a rehearsed restore, staging parity, GDPR export/erasure, a full specification / ADR process (31 ADRs).
- Designed and operate the multi-agent organisation that builds Alter: seven roles plus a scheduler over a git-backed ledger, delivering 178 merged PRs across 14 phases in nine months, solo.
- Concurrency-safe state model: single-writer files, one-file-per-fact sharding, and compiled (never hand-edited) indexes, eliminating a documentation-conflict livelock that was serialising parallel agents through full CI re-runs.
- Independent verification: every change fans out to a verifier and an adversarial breaker spawned on a deliberately thin brief (work-item + diff range only) so review cannot inherit the implementer's reasoning; black-box UAT structurally blind to the repo.
- Mechanical guardrails: capacity leases (file locks, disk-headroom refusal) with pre-execution hooks denying raw equivalents; limits enforced by the system, not by prompt instructions.
- Release engineering: typed release cuts with compiled user-facing changelogs; rebuilt the pipeline to cut hotfix-to-deployable-image from 60–90 min to 2–5 min via native per-architecture builds and digest-identical carry-forward of unchanged services.
- 0-to-1 AI filmmaking tool built around revision, not prompt-to-video: v1 a single agent over a typed dependency graph (cascade modes, consistency locks, a “converge” step); v2 a council of seven agent departments (producer, director, story, look & cast, camera, sound, unit + edit) through four production gates, all run from data by one five-role harness (assemble → generate → critique → resolve → record).
- Event-sourced core: an append-only production diary with actor, cause and cost on every event; every screen a rebuildable projection: causation chains (“why?”), time-travel replay, a per-department cost ledger, export/import of a whole project as one log.
- Coordination enforced in code, not prompts: single writer per artifact via a tool gateway; flags ruled on by a Director, never peer-to-peer; a convergence rule (no open revise/block flag, every department has evaluated the current version of every lock binding it); a bounded round cap that ends loops in a question to the human; paid generation kept outside the system as a human click.
- Working browser prototype through all four gates with replayable diaries; the mechanism write-up, the design document and the prototype are on this site.
- Directed and produced 2 AI short films end-to-end (story → moodboard → prompt engineering → consistent keyframes → ElevenLabs original scores); built an automated content pipeline.
Skills & Tools
- AI & LLM
- Multi-provider orchestration · agentic harness · structured outputs (Zod, tool-use) · prompt engineering, evals & cost budgeting · RAG / pgvector · fine-tuning & self-hosting · OCR
- Backend & Systems
- TypeScript · NestJS · Python · PostgreSQL · Redis / Bull · microservices & event-driven architecture · SSE streaming · ADRs
- Machine Learning
- XGBoost · Random Forest · KNN · hierarchical clustering · Monte Carlo simulation · WoE scorecards · time series · anomaly detection
- MLOps & Cloud
- Azure (AI Foundry, Fabric) · MLflow · Docker · GitLab CI · pytest / Jest / Playwright
- Generative AI
- AI video generation · AI music composition · automated content pipelines · prompt & storyboard design
- Regulatory
- GDPR · EU AI Act (regulated-finance AI delivery)
Education
Dissertation: long-term planning agent for sparse-reward environments using Monte Carlo Graph Search & Quality-Diversity search, directly relevant to modern agentic systems.