Ishaan Chaturvedi

AI Engineer · Production LLM & Agentic Systems

London, UK · [email protected] · LinkedIn · GitHub

Download PDF
2013 – 2017 BTech CS VIT · Distinction
2018 – 2021 · Mumbai ARCON data scientist · anomaly & fraud detection · user-behaviour analytics
2021 – 22 MSc AI QMUL · Distinction
2022 – 2025 · London PRA Group decision science · portfolio valuation · forecasting · scorecards
2025 – now AI Tiger Team agentic systems · self-hosted LLMs
2025 – now · own time Alter · harness · films live product, agent-built
  • 7+years production ML & AI
  • 178merged PRs, agent-built, solo
  • 4×T4s: self-hosted LLM stack, GDPR
  • 15AI use cases surfaced, company-wide
  • 5/8acquisitions at ~98% of projected value

Profile

AI Engineer specialising in production LLM and agentic systems, with 7+ years across enterprise machine learning and independent product building. I design, ship, and evaluate end-to-end AI inside regulated financial environments (self-hosted LLM deployment under GDPR, document-intelligence and agentic pipelines, enterprise-wide AI use-case discovery), focused on the parts that decide whether AI products survive production: evaluation, observability, structured outputs, and cost control. Independently, I architect and operate Alter, a self-hosted production AI product, and the multi-agent harness that builds it: 178 merged PRs across 14 phases in nine months, most of the code agent-written under independent verification. I also build Spiral, a multi-agent AI filmmaking tool: seven agent departments over an event log.

Experience

PRA Group · London, UK Oct 2022 – Present
AI Engineer, Global AI Tiger Team 2025 – Present
  • Selected onto PRA’s cross-organisation AI Tiger Team (reporting to an SVP) to identify and ship LLM and agentic AI use cases across US and international operations on an Azure stack: Azure AI Foundry, Microsoft Fabric, Google ADK.
  • Lead engineer and architect of two production agentic systems for the US business: a Disputes & Complaints investigation system (built end to end, in testing) and a Custodian of Records pre-legal document-validation system (nearly complete), each reading scanned correspondence and legal documents with GPT vision, reconciling them against the system of record, and producing cited, evidenced findings for frontline review.
  • Designed the shared verification platform both run on: typed Pydantic contracts, generic presence / doc-type / extraction / reconcile sub-agents, a registry-driven read-only SQL allow-list data layer, tiered vision-first document reading with Document Intelligence fallback, Managed Identity throughout, and a merge-blocking evaluation and AI-safety harness (golden sets, near-zero false-accept floors, injection / hallucination / guardrail suites).
  • Owned the north-star specifications and a results-first delivery plan (two-week iterations, each closing on a measured scorecard) under one rule: LLMs extract, deterministic code decides; every compliance-weight rule in versioned config, every conclusion cited.
  • Deployed a self-hosted, multi-model LLM stack on 4× NVIDIA Tesla T4 GPUs to keep regulated data in-environment under GDPR, routing to purpose-specific models (fine-tuned Mistral for summarisation, DeepSeek-R1-Distill-Qwen for reasoning).
  • Led a company-wide AI discovery initiative across every department, surfacing 15 high-value use cases, each quantified with effort–value scoring; built LLM + OCR pipelines over court documents (tiered legal failure-reason taxonomy) and foreign-language seller files, and agentic pipelines for affluence detection and customer-journey summarisation.
Data Scientist, Decision Science & AI Oct 2022 – 2025
  • Portfolio valuation & forecasting: end-to-end pricing of non-performing loan portfolios (KNN peer selection, pay-curve generation, calibrated recovery models), supporting 5 of 8 acquisitions now performing at ~98% of projected value.
  • Monte Carlo simulation: state-based simulation with a classifier for account-state transitions and a regressor for payment amounts; benchmarked XGBoost, Random Forest, and a Time-Series Transformer.
  • Collections decision science: WoE scorecards (avg AUC-ROC 0.74), 8 hierarchical customer clusters, optimised dialler contact limits.
ARCON TechSolutions · Mumbai, India Jan 2018 – Aug 2021
Data Scientist
  • Built near-real-time anomaly-detection models for a privileged-access-management product.
  • Developed an online hierarchical-clustering system for user-behaviour analytics.
  • Led a two-person team to ship fraud-detection analytics tooling, later adopted across the product suite.

Selected Projects

Alter · Production Agentic Capture Platform Lead / Primary Author
  • Self-hosted, live, paid AI product on an 11-service TypeScript / NestJS architecture (~289K LOC, ~40% tests); a two-stage LLM recognition layer classifies each input into a typed plan, files it autonomously, and auto-compiles a per-user knowledge base with hybrid search.
  • Agentic decision layer: migrated hand-written routing rules to model-owned decisions inside a deterministic spine (queues, budgets, gates, receipts unchanged); autonomy bounded by reversibility: autonomous filing, propose-only structural change.
  • Agentic workflows: multi-step plans with automatic re-grounding, branching, and end-of-thread synthesis.
  • Evals: golden eval suites as CLI runners with per-run cost budgets; prompts as tested, versioned components.
  • Multi-provider + structured output: Anthropic / OpenAI / Google / Perplexity abstraction with complexity-based cost routing, prompt caching, and strict tool-use + Zod schemas with retry-repair.
  • RAG: pgvector-backed hybrid (semantic + keyword) search over an event-driven reindex pipeline.
  • Production-grade: encryption-by-default, CI-enforced privacy invariants, per-user cost caps and entitlement gates, 6-hourly encrypted backups with a rehearsed restore, staging parity, GDPR export/erasure, a full specification / ADR process (31 ADRs).
The Harness · Multi-Agent Delivery System Designer / Operator
  • Designed and operate the multi-agent organisation that builds Alter: seven roles plus a scheduler over a git-backed ledger, delivering 178 merged PRs across 14 phases in nine months, solo.
  • Concurrency-safe state model: single-writer files, one-file-per-fact sharding, and compiled (never hand-edited) indexes, eliminating a documentation-conflict livelock that was serialising parallel agents through full CI re-runs.
  • Independent verification: every change fans out to a verifier and an adversarial breaker spawned on a deliberately thin brief (work-item + diff range only) so review cannot inherit the implementer's reasoning; black-box UAT structurally blind to the repo.
  • Mechanical guardrails: capacity leases (file locks, disk-headroom refusal) with pre-execution hooks denying raw equivalents; limits enforced by the system, not by prompt instructions.
  • Release engineering: typed release cuts with compiled user-facing changelogs; rebuilt the pipeline to cut hotfix-to-deployable-image from 60–90 min to 2–5 min via native per-architecture builds and digest-identical carry-forward of unchanged services.
Spiral · Multi-Agent AI Filmmaking Tool Designer / Builder
  • 0-to-1 AI filmmaking tool built around revision, not prompt-to-video: v1 a single agent over a typed dependency graph (cascade modes, consistency locks, a “converge” step); v2 a council of seven agent departments (producer, director, story, look & cast, camera, sound, unit + edit) through four production gates, all run from data by one five-role harness (assemble → generate → critique → resolve → record).
  • Event-sourced core: an append-only production diary with actor, cause and cost on every event; every screen a rebuildable projection: causation chains (“why?”), time-travel replay, a per-department cost ledger, export/import of a whole project as one log.
  • Coordination enforced in code, not prompts: single writer per artifact via a tool gateway; flags ruled on by a Director, never peer-to-peer; a convergence rule (no open revise/block flag, every department has evaluated the current version of every lock binding it); a bounded round cap that ends loops in a question to the human; paid generation kept outside the system as a human click.
  • Working browser prototype through all four gates with replayable diaries; the mechanism write-up, the design document and the prototype are on this site.
Generative Media Pipelines
  • Directed and produced 2 AI short films end-to-end (story → moodboard → prompt engineering → consistent keyframes → ElevenLabs original scores); built an automated content pipeline.

Skills & Tools

AI & LLM
Multi-provider orchestration · agentic harness · structured outputs (Zod, tool-use) · prompt engineering, evals & cost budgeting · RAG / pgvector · fine-tuning & self-hosting · OCR
Backend & Systems
TypeScript · NestJS · Python · PostgreSQL · Redis / Bull · microservices & event-driven architecture · SSE streaming · ADRs
Machine Learning
XGBoost · Random Forest · KNN · hierarchical clustering · Monte Carlo simulation · WoE scorecards · time series · anomaly detection
MLOps & Cloud
Azure (AI Foundry, Fabric) · MLflow · Docker · GitLab CI · pytest / Jest / Playwright
Generative AI
AI video generation · AI music composition · automated content pipelines · prompt & storyboard design
Regulatory
GDPR · EU AI Act (regulated-finance AI delivery)

Education

MSc Artificial Intelligence (Distinction) · Queen Mary University of London 2021 – 2022

Dissertation: long-term planning agent for sparse-reward environments using Monte Carlo Graph Search & Quality-Diversity search, directly relevant to modern agentic systems.

BTech Computer Science & Engineering (Distinction) · Vellore Institute of Technology 2013 – 2017