The Lean Startup: How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses · chapter 7 · member edition

Measure

So what

Innovation accounting is the book’s weakest intellectual contribution. The vanity vs. actionable metrics distinction is sound advice, but it was not original – Dave McClure’s AARRR (2007), Andrew Chen’s growth writing (2008), and Fader & Hardie’s cohort methods (2005) all precede Ries with greater specificity. A/B testing was pioneered by Amazon and Google in the early 2000s, not by lean startup. The GE FastWorks case study is the most damaging: Ries was paid to consult, then cited GE as evidence his methodology works at scale, and GE subsequently destroyed hundreds of billions in shareholder value. Using your own consulting client as proof of methodology while that client is in terminal decline is a conflict of interest that the chapter never acknowledges. The IMVU innovation accounting claims are entirely self-reported by Ries about his own company, with no independent verification. The chapter identifies a real problem (how to measure startup progress) but offers a solution too vague to implement and too conflicted to trust.

Verdict

SignificantBS

Claims checked in this chapter (6)

contested⚠ re-audit pending
Innovation accounting is a new way to measure progress for startups, using three learning milestones: (1) establish the baseline, (2) tune the engine, (3) pivot or persevere. This fills the gap where traditional accounting fails.
needs context⚠ re-audit pending
Startups should distinguish between 'vanity metrics' (total signups, page views) and 'actionable metrics' (per-cohort conversion rates, retention) that drive real decisions.
contested⚠ re-audit pending
GE's adoption of lean startup principles through the FastWorks program demonstrates that innovation accounting works at enterprise scale.
holds⚠ re-audit pending
Cohort analysis -- tracking metrics for groups of customers who joined during the same time period -- is the foundation of actionable metrics and reveals patterns invisible in aggregate data.
needs context⚠ re-audit pending
A/B testing (split testing) is a key technique for innovation accounting, allowing startups to measure the impact of specific changes on customer behavior.
contested⚠ re-audit pending
IMVU used innovation accounting to track per-customer revenue improvements, demonstrating that actionable metrics drove real business decisions at the company.