The problem
Revenue teams already record everything — every call transcribed, every email logged — and still run Monday pipeline reviews on gut feel, because nobody can read it all. The result is a familiar tax: CRM stages that flatter the rep, forecasts negotiated instead of derived, and losses whose causes were audible on a call three months before the deal died.
The brief: given 18 anonymized sales-call transcripts — 11 open deals, 3 closed-won, 4 closed-lost — design how AI should turn calls into an operating system for the whole revenue team, and pitch it to RevOps and GTM leadership. Deployable in 1–3 months on the real stack: Gong, Salesforce, Outreach, BigQuery, Polytomic, Sigma, Slack.
Who it's for
Each stakeholder gets a different product from the same loop, and the design treats them separately because adoption dies when it doesn't:
- The CRO / founder buys forecast credibility — a pipeline number derived from call evidence, not negotiated in a room.
- RevOps owns the system: one source of truth per metric, a stack that doesn't add new vendors, and an audit chain for every number.
- Sales managers get Monday's pipeline review pre-built — the deals where the CRM and the calls disagree, ranked by revenue at risk.
- Reps are the make-or-break constituency. The system drafts their CRM hygiene instead of adding to it, and it never overrides them on forecast — it surfaces disagreements, and the manager conversation is the product.
The approach
One loop, closed: transcripts → structured signals → CRM & warehouse → dashboards & forecasts → outcomes → feedback that improves the signals. Every design decision exists to keep that loop closed.
Three signal families, fifteen scored measures, each with an anchored 0–3 rubric:
- ICP Fit — does the evidence say this is our buyer?
- Stage Accuracy — does the call support the CRM stage the deal claims?
- Deal Momentum — is this deal actually moving, or just aging?
The non-negotiable rule: no score without evidence. Every score cites a transcript quote with speaker and timestamp, so any number in a dashboard can be walked back to the sentence that produced it.
Running the framework over the cohort produced the findings that made the deck land:
- 9 of 11 open deals looked healthy on the ICP × Momentum matrix — but two of the four recent losses had scored a perfect 15 on ICP fit. Fit isn't the failure mode; momentum blindness is.
- Six open deals sat at the wrong CRM stage for the call evidence — three claiming further along than the calls support, three actually further along than the CRM knew.
- One deal got a confident over-call from the extractor that human review caught — which became its own (hidden) audit slide, with a fix mapped to every layer of the reliability framework.
Architecture decisions
- Multi-stage pipeline, not one mega-prompt: per-signal extractors with structured JSON outputs and tiered model routing — cheap models for extraction, capable models for judgment, unit cost visible per deal.
- Buy the plumbing, build the judgment: no new vendors. Gong already records, BigQuery already stores, Polytomic already syncs. The build is the signal layer — the one piece with proprietary value.
- One owner per number: BigQuery is the single source of truth for derived fields; Polytomic is the single reverse-ETL pipe into Salesforce; Sigma and Slack are read-only. No two systems compute the same metric.
- Six known failure modes, six specific defenses — a reliability and trust layer designed before scale, not after the first incident.
Business impact
Designed as an investment case, not a science project:
- 90 days to the first closed loop on the existing stack — no new contracts, no data migration, no rip-and-replace. The wedge is one meeting: Monday's pipeline review runs on signal-ranked deals from week one.
- The cohort math is the ROI argument: six of eleven open deals mis-staged means the forecast was wrong before any model touched it. Correcting stage truth alone changes the number the board sees.
- Loss prevention beats loss analysis. The two lost deals that scored perfect on fit both showed momentum decay in the calls while the CRM said "on track" — signal that existed months before the loss. Catching one such deal pays for the system.
- Cost scales with call volume, not headcount — per-deal extraction is pennies; the expensive judgment models run only on the deals that matter.
Risks & guardrails
The deck dedicated a layer to this, because trust is the actual product:
- Hallucinated confidence is the named failure mode — one extractor over-call was caught in human review and turned into an audit slide with a defense mapped to every layer.
- Evidence-or-silence: a signal with no citable quote doesn't ship to a dashboard. Better a gap than a guess.
- AI never overrides reps on forecast — it flags divergence for a human conversation. That single rule is what keeps the rep constituency from quietly killing the rollout.
- Rubrics are versioned and retrained on outcomes, so scoring drift shows up as a diff, not a mystery.
Where it goes next
The blueprint is delivered; the natural sequel is the live build — extractors on a real Gong feed, the momentum rubric hardened against a full quarter of outcomes. The meta-point stands either way: the case study was built with the same discipline it proposes — structured extractors writing to disk, evidence-cited outputs, version-controlled frameworks, an audit chain from any slide claim down to the transcript line.