Why should you have a zero-defect strategy?
July 28, 2015
Part of the logic of a zero-defect strategy is about psychology: specifically, the psychology of the developer working on code that they know is flawed. The other part of it is just good business practice...
We’ve all heard many times that the cost of identifying a bug in production is exponentially more expensive than identifying a bug in development.
If you take an approach of “some bugs are acceptable to roll into production” then effectively what you’re saying is “I’d rather spend more money later than less money now fixing this problem”. If you do that more than once or twice then you start to build your house on sand.
Imagine a developer working on a feature, relying on other components that have some well-known defects in them. They’re relying on these components to get their feature working. The developer thinks long and hard about their feature. They implement the code. They run the tests. Something breaks.
The natural reaction is to think that the known problems in the dependent components are more likely to be the problem, rather than an unknown problem in the developer’s code. They’ve spent a long time on that code. They’ve thought it all through. It should work.
The developer knows that the component they’re depending on is flaky, so go ahead and commit this code, knowing there’s a bug in the other feature. That’s not their problem.
This problem becomes exacerbated. The developer is not being absolutely 100% pure in their implementation. Buggy code is being delivered, whether it’s in their feature or another feature. The whole problem then multiplies. The next developer comes along thinking they’re relying on the feature they know is buggy. They’re also relying on a feature that doesn’t work because that developer is relying on a feature that’s buggy. They’re going to take more time to fix the feature. It’s been a long time since the original bug was identified. No one seems to care. They won’t waste their time fixing that.
Their bit of code will work in certain scenarios, but not in this scenario because it’s know there’s a problem. So the code isn’t actually tested for that scenario, even though it’s been written so that one day - if that feature is fixed - that code will probably work (or it may not).
Eventually the whole code base, over time, becomes riddled with holes. Everyone has justified that these holes are acceptable. Every time a new feature is built, it’s being built on a very fragile code base. Only the well-travelled code base paths are bug-free. All other paths are full of pit holes that aren’t understood.
Maintaining a huge code base, full of pit holes, is very expensive.
The buggy code should be removed. Either fixed or acknowledged that it’s not going to use a feature and remove it. Otherwise a whole load of 'debt' is built up. Not even technical debt, just feature debt.
The easiest thing to do is nip it in the bud. You should be saying:
- We are going for zero-defect code
- Each feature we build will have zero-known defects
- As soon as we discover a defect, we will remove it/fix it/stub out that bit of code, we don’t need it anymore
- We should invest the time in making sure there are no problems in the code
Malcolm Gladwell talks about the Broken Window Syndrome - the then Major of New York's approach to zero-tolerance of small crimes, like broken windows in disused factories, that tolerate ever-larger crimes. This is exactly that. Manifestation in code.