Eric Ries’ 2011 book “The Lean Startup: How Today’s Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses” has garnered lots of attention, and indeed plenty of favourable reviews. He’s a thoughtful guy, who has been gradually building up interest in his “Lean Startup” ideas over the last few years: if you haven’t really heard of it, it’s basically an abstract conceptual toolkit aimed at very young companies that offers plenty of sensible-sounding advice, with very little to obviously disagree with.
But even so, I think that Lean Startups still suck. And here are ten big reasons why:-
(1) The “Lean Startup” approach is not a science. In fact, even though much of it is couched in terms such as “empirical” and “hypothesis”, it’s not even properly scientific. What it offers is a load of consulting-style models mixed in with contemporary truisms about business presented as hypotheses, which Ries hopes you will then go out and test for yourself. Why? Because despite all his evangelism, so few businesses have actually tried being lean startups that he hasn’t yet got enough data points to construct convincing arguments for his book. Which is why he so wants you to go test his ideas for him with your money and your business on your customers. If his ideas were scientific, they would have been tested already: but because they’re not, they’re merely hypothetical, which is a different thing altogether.
(2) “Lean Startup” is not a Scientific Management theory. I’ve seen Eric Ries talk, and he likes to claim Scientific Management as a (retrospectively adopted?) parent of Lean Startups, but in practice that’s simply not so. True, he likes metrics (and Frederick Taylor’s ghost would surely approve of that): but metrics and dashboards have been in high management theory vogue for well over a decade, so they are merely things that Ries has appropriated rather than devised in any useful way.
(3) “Lean Startup” is not a Quality System for R&D. The core of Ries’s claims is that his Lean Startup ideas provide a more productive way of getting to “product/market fit”. However, in its current state it is not even remotely close to an ISO-9001 approach for systematizing R&D: as a general rule, I’d say quality systems are a poor fit for R&D companies. Rather, the key test Ries applies to everything is relentlessly Darwinian: is your product a good market fit yet? (If not, iterate and try again). But as far as I know, there is as yet no substantive academic research on whether relying so utterly on customer feedback is in fact a good way to design new things: it could be argued just as strongly that it’s merely an effective way of making incremental design changes.
(4) Lean Startups are unfundable by angels. I estimate that 95%+ of current business angels (oh, and 99%+ of VCs, too) would not currently invest in any lean startup. This is because the Lean Startup toolkit has a single operating model: a Zen state of sustained-yet-aggressive ignorance while you intuitively develop some kind of tentative product-market fit by repeatedly bouncing things off enthusiastic early customers. Even though this may be in some ways inevitable if you’re trying to build a startup using your own savings, it is anathema to almost everyone looking to back a startup. I’ve talked with 130+ business angels, and almost without exception I would say that they want to put money into small, highly productive teams who have the self-belief that they already know what they are doing, so that those people can get on with executing their plans and making them work. Angels don’t want to fund your industrial education, they want to fund your market-focused business.
(5) Lean Startups are not lean. That is, as far as I can tell the ‘lean’ part of the title was merely appropriated from “Lean Manufacturing”, which - I would argue - bears almost no relationship to Eric Ries’s customer development ideas (which were instead built to a very large degree on Steve Blank’s Customer Development ideas). In fact, Ries’s idea’s correct title should probably be “The Learn Startup” because it is 100x more to do with learning than with reducing process waste and quality management: it’s certainly not to do with doing things cheaply or even fast, because educating yourself into a constantly changing market via progressive iteration can take an entire lifetime, and can happily absorb every penny you care to throw at it.
(6) Lean Startups makes little sense outside Web 2.0 startups. If you are considering setting out as a “lean startup” manufacturer, I’d urge you to think again. Iterate with your customers all you like, but you still need to pony up heavy-duty capital when setting up a manufacturing process, and the Lean Startup consulting toolkit is of little use when funding or developing this kind of thing. Regardless, you’d probably be better off reading up on mechatronics development, because this covers an awful lot of the same area (did I mention that it’s not new?) without telling you that you need to iterate in order to build worthwhile things.
(7) “Lean Startup” ideas have not yet been tested. Look, anyone – and I do mean anyone – can assemble a set of contemporary-sounding statements about how best to run a business, and then claim that the multiple similarities between those statements and carefully-selected details of the runaway success of { Google | Facebook | whatever } form cast-iron proof that your overall theory works universally. Eric Ries knows (and indeed points out) that this does not amount to any kind of real wisdom: however, because he has as yet amassed no real data, I think this is exactly what his ‘Methodology’ reduces to.
(8) Lean lacks cojones. Or “bravery”, if you wish. By delegating design decisions purely to the result of customer iterations, it encourages startups to produce incremental me-too wannabe products that appeal only superficially to customers, and to make design decisions based more on incrementalism than disruption. As such, it is a way of developing things that is intrinsically anti-engineering. Yet I would argue that to build company value and have lasting societal impact, startups need to be (quite literally) revolting.
(9) Lean is not a movement. It is not even a popular revolution. It’s one guy touring the world telling developers telling them how smart they are, and selling them an unsustainable dream – that it is in their power to build their own company cheaply and effectively by iteratively running prototype product versions past early adopter customers. It’s a tempting notion – after all, it’s the same basic dream that fills hot desk seats in Old Street and all the other tech hotspots worldwide. But ‘ought’ doesn’t make it ‘true’, no matter how many times you say it to audiences who would like it to be true.
(10) It would be nice if Lean was truly as good as Ries claims. But it’s not. In some idealized parallel universe, it might well possibly be true. But in this particular universe, it is at best no more than a technical hack for trying to avoid really big customer-facing design mistakes. So, unless you (and your optimistic co-founders) can entirely self-fund your killer startup through a (probably very prolonged) lean development phase, I would strongly advise taking your Lean Startup noodle soup with a large pinch of salt.
Comments on: "Lean Startups suck. Here are 10 reasons why…" (18)
Fighting talk Nick! An honest review and great food for thought. I have certainly fallen into the Lean Trap and have found my wheels spinning… doing neither my startup nor my consultancy particularly well. Time to get off the Eric Ries bandwagon
Phillip: thanks for commenting! For me, startups face three big challenges: technology, customers, and politics (which includes funding). Eric would like it to be true that you can get by with only the first two, but this ain’t so, certainly in the UK.
Perhaps this points to the real underlying story here, that the Lean Startup thing is no more than a hopeful byproduct of the US startup finance bubble – i.e. that Eric can’t conceive that getting funding on reasonable terms might be a non-trivial exercise, which is why he tries to reduce everything to a Bach-like technology/customer development fugue. Just a thought!
Thanks Nick for this review. Given that most new businesses fail within five years it is important to thoroughly assess new methods to building businesses, particularly when they are somehow hyped up. Here are some thoughts on the first three points raised based on my postgrad research in entrepreneurial planning and my own experiences as a nascent entrepreneur:
I’m no too familiar with how Ries explains and sells his concept but to me it’s the combination of prototyping and customer development. Steve Blank’s customer development process, which in academic literature is referred to as “discovery-driven planning”, is what really gets me. Whereas I don’t think the details of the concepts are too important, I think checking continously whether what you are planning on building adds value is one of the most crucial steps in exploiting untested market opportunities.
(1) The “Lean Startup” approach is not a science: “If his ideas were scientific, they would have been tested already”
Ries should use the word scientific carefully in my opinion to avoid confusion.
He promotes the continuos testing of hypotheses/assumptions. This is what I believe he means by scientific approach to building a company. Because that’s what positivist scientists do, they take a dependent and independent variable, make an assumption as to how a change in the independent variable influences the dependent variable and then verify or falsify this hypothesis. This is the method/concept.
Whether this method works or not has not been proven scientifically. But then again, no other method to building a new venture has been proven to work scientifically. For instance, the business planning-performance relationship has been extensively and comprehensively tested since the 1980s and even quantitative researchers in 2010 acknowledge that the results are completely inconclusive. “Discover-driven planning” is a relatively new concept from the 1990s (whereas the business planning framework can be traced back to strategic management literature in the 1957) and yet is to be tested in a positivist and quantitative manner.
(2) “Lean Startup” is not a Scientific Management theory:
Good point, if I were Ries I would not link entrepreneurial concepts (opportunity-seeking) with managerial concepts (advantage-seeking). They are fundamentally different.
(3) “Lean Startup” is not a Quality System for R&D:
I must admit I didn’t fully understand this part of your interesting article, so please correct me if I’m wrong.
“not even remotely close to an ISO-9001 approach for systematizing R&D”
Like productes, ventures go through life cycles. One attribute of these cycles are formal systems, which at the beginning are 0. In other words, ISO-9001 is typically not a concern of a nascent entrepreneur.
“there is as yet no substantive academic research on whether relying so utterly on customer feedback is in fact a good way to design new things: it could be argued just as strongly that it’s merely an effective way of making incremental design changes”:
My understanding was that the concept has it that you should test your innovation, radical or incremental. So you develop the ideas first then you test. Ries doesn’t advocate going to people first and ask them for incremental innovations.
Looking forward to hearing your opinion on this.
Michael: thanks for your detailed response. As far as quality systems go, Ries seems to me to be advocating a development process (repeatedly test successive iterations on customers) while making quality-style claims (‘lean’) for its efficacy. By stressing his proposed process’s alleged scientific credentials, he seems to be presenting it as if it is a quality-assured scientific management process. But R&D simply doesn’t work like that.
My point in that section was really that proper innovation is about making game-changing leaps, whereas Ries’ view of innovation seems to be heavily constrained, almost as if he only considers Web 2.0 social media hacks as the limits of that-which-can-be-invented-now. In my experience, customers rarely propose big changes to anything you show them, which helps to reinforce a “micro-pivoting” incrementalist mindset. Hope this is a help!
I am with you on pseudo-science (you cannot help but be amused by guru-ness) but I think you are completely off on point #4.
Lean or similar concepts (we used to say Prove/Build/Scale, whatever, they’re all just useful elements in a toolbox) are being used by experienced entrepreneurs. They posit hypotheses (that’s a codename for their very strong vision on what the business model should be) but they test against the reality of their market early.
Evidence (Startup Genome) suggests companies mostly fail because they are not answering customer needs properly (this applies even to disruptive innovation).
As for Angels not funding lean-style startups, that’s just bullshit. Angellist is littered with hundreds of lean startups who got funding from great angels. Why, it’s even the opposite. The “do more with less” mentality is what makes angel investment the fundamental bedrock of seed stage innovation that it is today.
I don’t know who these 130+ business angels are, but they don’t sound like to 30 odd I work with on a regular basis.
* Eric is a clever guy, but he presents his ideas with an unsupportable universalism. Positivist scientists claim to test their (implicitly separatable) hypotheses one by one, but only rarely do startups (or indeed real scientists) have sufficient runway or sufficiently separable hypotheses to do this. Getting to the start of the J-curve in a properly scientific way would require a level of resource of a Toyota or Canon: in practice, entrepreneurs have to get used to being resourceful in every other sense of the word.
* The Startup Genome project suffers intensely from sampling bias (do they even know that self-selection yields unusable statistics?) and in my opinion falls well short of being real evidence. Was it set in motion to help entrepreneurs improve or to upsell inappropriate consultancy to companies that can least afford it? Looks like the latter, I’m sad to say…
* As far as AngelList goes, I think it is actually “littered” with angels funding speculative projects run by second-time or third-time entrepreneurs whom they know and trust with their money (say, ‘trust punts’), quite independently of whether or not they happen to call themselves ‘lean’. I expect nearly all such projects are funded despite lean, not because of it.
* “Do more with less” is what good startups have always done, I’m sure you know the whole Robert X. Cringely “commando” thing well. For me, it’s how I’ve always run high-productivity dev teams and companies, but that doesn’t retrospectively make me part of Ries’ movement. I tell mentee entrepreneurs that startups have only two things – money and brains – and guess which one usually runs out first?
* Finally, I’ll take a wild guess that your 30 regular angels aren’t based in the UK’s Home Counties!
Cheers, Nick.
Angels who don’t understand startup risk influencing company strategy = tail wagging dog. Same is true for VC.
I tend to agree with your summation. It is not such ‘lean’ but ‘expensive’. However, I will stand up for it as being a damn fine place to start. Fill in the gaps, think about what you are producing and for whom.
Much past that point, if you don’t know who your customers are and what you are going to build, you probably shouldn’t be in the startup industry.
By all means build ‘lean’ but build one. Correctly the first time. Spend the extra month thinking and planning.
1. The ideas are being tested at Lean Startup Machine, and it’s very empiric. If you’d like to come feel free to email me trevor [at] theleanstartupmachine.com
2. Weak point, what are you saying? Or maybe, who cares?
3. Again you’re missing the point.
4. Simply not true. Examples of Lean Startup include: DropBox, Etsy, Kickstarter, eHarmony, etc. these are all VC backed
5. Wrong, Lean Startup avoid waste by focusing on large changes to their business model before PM/FIT rather than optimization.
6. Eric gives several examples in the book outside of Web 2.0, how did you miss these?
7. I have data
Got tired of reading the other responses. Please come to Lean Startup Machine or email me, I feel like you’re just on the wrong wave-length here.
Trevor: perhaps I’ve woken up feeling grouchy, but I have always reserved a special corner of Hell for those who sell consulting toolkits and conferences to entrepreneurs starting up – and I can’t see any reason not to place The Lean Startup Machine’s £175 UK conference in that same dismal corner. As far as your bullet points go, suffice to say that real knowledge knows its own limits, rather than being touted as a panacea: by that measure, Lean Startup is not yet even close to being real knowledge.
Hi Nick,
You make some good points here – I find myself agreeing with some and disagreeing with others, but I’m wondering why we have different conclusions.
I’ve always been interested in how much mileage people get out of these attempts and crystalizing entrepreneurship methods – not just Lean Startup, but also things like Rework, E-Myth and so on. I’d really like to know your story, what Lean Startup approaches you’ve tried and what didn’t work.
You’re right that, in the bigger picture, Lean Startup is largely untried-and-untested. Sure, there are loads of examples of successes, including BufferApp.com, based here in the UK, but all of these examples don’t make a scientifically-sound management theory. The problem with this argument is, is it a realistic benchmark? What scientifically-sound management theory exists? Is there a more useful way to spend our time than debate this? I’m very interested in specific stories and examples, good or bad – so we can learn from them and adapt. The more theoretical debates are interesting to me, but I don’t put much time into them. I am interested in your story though, since what we can learn from that is actionable.
He’s said openly that people that use Lean Startup methods are consenting guinea pigs, so you’re absolutely right about that. Eric Ries is actually really clear that this stuff need to be used and tested more, and that’s his intention. I don’t see it as a criticism in and of itself though – everything new and good needs to go through this phase. Of all the management leaders out there, he’s one of the more honest about this. Accepting this, I’m interested in improving upon Lean Startup, which is why I’m interested in what specifically doesn’t work for you and others.
I’m not sure if you’ve been to any of the Lean Startup meetups or Leancamp events in London or Scotland. There’s a really supportive community there where you’ll find others, including me, who are trying this out, trading notes and supporting each other. Please come! I’d also love it if you got in touch with me directly so I could better understand where you’re coming from, and see if I can help out if possible.
I know that you have people’s interest at heart when you write a post warning people off of something you don’t believe in or find harmful. That’s commendable – community-minded and charitable. To me, that puts you in the same category as Trevor.
I just need to clarify something though. I helped Trevor, Kelley and all the other volunteers with bringing the LSM event to London because I thought it would be helpful for people to experience. And the majority of the participants found it eye-opening and educational. Trevor works hard to help entrepreneurs, and the cash from the LSM London tickets went to pay hard costs – everyone involved is volunteering and trying to help entrepreneurs, just like you.
So, please take this as it’s intended- as a respectful suggestion from someone who also wants to help – I think you’re out of line in chastising Trevor in this case, and even for chastising Eric Ries, who has also spent years volunteering, trying to help entrepreneurs by debunking incumbent Management Think. For where I stand, looks like these guys might be on the same side as you.
If you’ve had problems with applying Lean Startup yourself, I truly want to either help you overcome the issues you’ve faced, or for us as a community to learn from your specific experience.
While a critical questions are very useful, this type of negative, personal attack doesn’t really fly in the community so you won’t get as much out of it if that’s your approach. In terms of UK investors specifically interested in the Lean Startup approach, I know of quite a few. If they’re reading your attacks on others in the Lean Startup community, I don’t think this helps the chances they reach out to you, so I invite you to get involved and share your experience with us. (Try it as an unscientific experiment!
) Up for it?
Cheers,
Sal
Sal: what an unexpected pleasure to have you drop by my small corner of the web, nice to meet you!
My startup story? Having worked for various security camera companies (twice as CTO), I saw a gap for a new type of CCTV camera designed for reliability, invented it, and decided to try to build a startup around it, giving it my best shot (and all my savings). Having first priced up the likely cost of getting it to market with IP in hand (~£1m), I’ve spent the years since finding suppliers (which Lean actually makes 10x harder) & customers, and demoing a series of prototypes to mentors, industry insiders, investors and (of course) eager customers, all the while solving countless social, cultural, technological and political problems. Basically, the game of “Honey, I Shrunk the Risk” angels like you to play using your own money rather than theirs.
You might think what I did would be a perfect Lean case study, insofar as it has been on a shoestring, involving a bit of bootstrapping (building cameras for other security companies), and making progress used brainwork + customer-facing iteration rather than a mountain of equity-funded cash. However, (a) it has taken a ridiculously long amount of time, (b) that time has come at great personal cost to both myself and the people close to me [don't even ask], (c) many (if not actually most) of the investors I have pitched to and talked with simply don’t want their money going into anything remotely like lean startups, while (d) even though the company has now (finally!) pretty much got to product/market fit, the journey ain’t over yet.
I suspect my blog is pretty much a kind of self-help therapy programme to help me deal with the unbelievably high tension between Lean Startup ideas and Startup Finance ideas. Perhaps because I have a background both in running high-productivity low seat-count dev teams and in mechatronics, nothing in Lean came as a surprise to me: once you’ve seen Steve Blank’s diagrams, it’s all pretty straightforward, and I guess this is just as true for plenty of other broadly similar dev guys. Yet as I said to Trevor, the issue with Lean Startups lies mainly in knowing when it becomes a hindrance rather than a help to your startup, i.e. knowing the limits of its applicability. In the lifecycle of my company, I think I hit that point about 18 months ago, which was pretty much when I started blogging.
So right now, I don’t see anyone asking proper Lean questions to establish the limits of its applicability to UK startup funding, such as:-
* How can you price a lean startup, if the EIS won’t let you use convertible notes to dodge the issue?
* How can you negotiate with an angel over valuation, if you don’t really know what your product or market is?
* What kind of contractual expectations can a Lean Startup negotiate with an angel, given that he/she is in a self-declared position of ignorance?
…and so forth. I’ve discussed this kind of thing with Eric, but the impression I get is that he doesn’t see it as anything like the issue I do, and that he thinks time will heal this as his ideas slowly percolate through to angels. Or perhaps his view is so tightly channelled by the ongoing US startup finance bubble that what I see here in Europe is just not meaningful to him.
But what I think he’s missing is that even when angels do understand Lean, they don’t necessarily like it – it’s a bad fit for how almost all of them work. The biggest misconception of all is that Lean has some kind of monopoly on high capital efficiency (that’s what startups have always had, that’s what they need to get by), when actually what Lean does is to replace focused reflection and engineering with time and customer-mediated interactivity. My experience is that that’s usually a good trade early on in a startup’s lifecycle, but as time goes by it becomes less and less tenable.
As far as the LSM goes, I simply can’t square a £175-per-ticket conference with the bruising, difficult experience I – and countless others like me – have in starting up their small company. For me, £1 of pre-funding money is worth close to £50 of equity cash, which pegs the typical equivalent equity cost of attendance at £8750. I’m not saying your / Trevor’s ideals and intentions in volunteering to help with it weren’t good, rather that it’s a format which I simply can’t personally endorse. Meetups in rooms above pubs are good, though.
I’d happily give a talk on “When Lean Works And When Lean Sucks”: just because I listed 10 downsides doesn’t mean I can’t see the upsides too. But those people who spend all their time proselytizing solely on Lean’s upsides (and I’m sad to say that I’d tend to include Eric Ries in that category, for all his undoubted generosity of spirit) really don’t help the overall cause – they’re the ones who make it, in Fred Destin’s words, like a “Lean religion…”, to be taken “with a pinch of salt”.
Finally, if those Lean-friendly investors you know are actually experienced investors, then I’m pretty sure than none of this will be remotely surprising to them. Lean is a sensible (if often rather slow) way to self-fund a company while you gradually build it to the point that it’s investment-ready: but it also offers a thoroughly lousy interface between entrepreneurs and investors, something that Eric will doubtless have to pivot many times around in years to come. Ask them about this, see if they agree or disagree.
Hi Nick,
I value your opion and everyone who has made a comment!! Your right LEAN is OVER SOLD BULLSHIT By People who can read books………and travel the world to share the learning.
I’m a guy who left school went through college joined the ARMY and worked in a factory…..
BOOOOO Me, no!!!!
I work hard for companies all over the world! NO , not selling Bullshit!!!! Supporting them to stay a float in this GFC Situation not with stats not with Lets do A Value stream!!!!!
Get off your Arse and Manage Your company be HONEST. The fat cats always want to get FAT.
Deal with it!!!! How can you keep a Business running and make Profit and Help your Employees.
Its Simple if you know How……. No-one Knows , You can all but try……. I’m on a Salary working for a LEAN consultancy firm! 4 years now!!!! i’m in Australia and have continued to support my clients implementing Lean across a wide range of organisations Its not easy….. i DONT use sigma i use COMMON SENSE!! GRAFT and a sense of Belief. CHANGE is upto you….If you dont want to change you wont. IF you have poor Man Management Skills it will Reflect on your Staff.What im trying to stay is, if a company is not doing as well as it can………ASK why! Listen to your Staff and HELP THEM…. It’s SIMPLE …LEAN = COMMON SENSE.
Unfortunitly we all don’t have it.
Lee without a Degree
Take this with a pinch of salt.
Degree-free Lee: in your work, do you advise manufacturing companies about Lean Manufacturing, or do you advise skinny-arsed latte-drinking social software startup guys about Lean Startup Philosophy? If the former, then more power to you, your company and your clients, because that’s proper stuff: the latter is just a bit sucky by comparison.
[...] approach the participants described (customer-focused, iterative, uncertainty-based, etc) was to the whole Lean Startup thing. And the more I’ve thought about it since, the less I can see any obvious [...]
[...] startup heretic, challenging us to question new sets of assumptions and dogmas in his blog post Lean Startups suck. Here are 10 reasons why…. Be Sociable, Share! Tweet [...]
The Lean Start Up Machine approves this message.
[...] (4) Don’t get me started on process cults (particularly the whole Lean Startup thing) - tiny techy tails trying to wag big complex dogs, driven by people brandishing [...]