A toothpaste factory had a probem: they sometimes shipped empty boxes, without the tube inside. This was due to the way the production line was set up, and people with experience in designing production lines will tell you how difficult it is to have everything happen with timings so precise that every single unit coming out of it is perfect 100% of the time. Small variations in the environment (which can’t be controlled in a cost-effective fashion) mean you must have quality assurance checks smartly distributed across the line so that customers all the way down the supermarket don’t get pissed off and buy someone else’s product instead.
Understanding how important that was, the CEO of the toothpaste factory got the top people in the company together and they decided to start a new project, in which they would hire an external engineering company to solve their empty boxes problem, as their engineering department was already too stretched to take on any extra effort.
The project followed the usual process: budget and project sponsor allocated, RFP, third-parties selected, and six months (and $8 million) later they had a fantastic solution — on time, on budget, high quality and everyone in the project had a great time. They solved the problem by using some high-tech precision scales that would sound a bell and flash lights whenever a toothpaste box weighing less than it should. The line would stop, and someone had to walk over and yank the defective box out of it, pressing another button when done.
A while later, the CEO decides to have a look at the ROI of the project: amazing results! No empty boxes ever shipped out of the factory after the scales were put in place. Very few customer complaints, and they were gaining market share. “That’s some money well spent!” – he says, before looking closely at the other statistics in the report.
It turns out, the number of defects picked up by the scales was 0 after three weeks of production use. It should’ve been picking up at least a dozen a day, so maybe there was something wrong with the report. He filed a bug against it, and after some investigation, the engineers come back saying the report was actually correct. The scales really weren’t picking up any defects, because all boxes that got to that point in the conveyor belt were good.
Puzzled, the CEO travels down to the factory, and walks up to the part of the line where the precision scales were installed. A few feet before it, there was a $20 desk fan, blowing the empty boxes out of the belt and into a bin.
“Oh, that — one of the guys put it there ’cause he was tired of walking over every time the bell rang”, says one of the workers.

Rodrigo Yoshima | 21-Jul-08 at 7:22 pm | Permalink
That’s the price you pay when you put the wrong people in the wrong project with the wrong vision on the wrong problem.
Débito Técnico » Blog Archive » Hierarquias são inteligentes nas “pontas” | 21-Jul-08 at 8:20 pm | Permalink
[...] texto foi publicado no blog do Carlos Vilella, achei tão bom que decidi [...]
Hugh’s ramblings » Blog Archive » Toothpaste | 21-Jul-08 at 11:53 pm | Permalink
[...] Villela has a great story about manufacturing toothpaste. [...]
Fabio Nascimento | 22-Jul-08 at 10:22 am | Permalink
Excelente texto.
CV isso mostra que as vezes soluções pequenas são mais rentáveis do que as mega-soluções impostas por algumas empresas de “3 letras”.
Estou repassando este texto ao meu Líder Técnico.
Fabio Nascimento
Marcio Duarte | 22-Jul-08 at 5:25 pm | Permalink
Of course they fired the guy with the Fan… After spent $8 million, who will assume the blame for that… hehehe…
Alain | 30-Jul-08 at 2:53 am | Permalink
Hm. Nice anecdote.
That said.. How did a worker get annoyed at the bells (caused by the scales picking up defective product) if the scales never picked up a defected product in the first three weeks?
Cute nonetheless, and well delivered. Though I’d also laugh at the company that spent $8M installing production-slowing precision scales, even if there were no easier solution.
Helmen | 31-Jul-08 at 8:21 pm | Permalink
That is a rip off of an actual true Japanese Soap factory story. Fuck you.
Carlos Villela | 31-Jul-08 at 11:17 pm | Permalink
Hi Helmen,
Mind posting a link that verifies your claim?
Thanks.
Rod | 11-Aug-08 at 8:37 pm | Permalink
Looks like a “urban legend” kind of story… Interesting though.
I don’t know if the Japanese version is the real true or not, but I found a link with a very similar text posted on 2007.
http://www.indusladies.com/forums/sundays-with-varalotti/8050-hard-work-vs-smart-work.html
I also watched a movie where a guy claims that it happened in a big multinational company’s factory in Valinhos. The story he tells is very similar, including the $8M spent…
The Punch Barrel / Networks Are Smart at the Edges | 12-Aug-08 at 11:21 pm | Permalink
[...] lixo.org :: Networks Are Smart at the Edges [...]
Ian S | 14-Sep-08 at 2:38 pm | Permalink
If you people saying this story is made up, had ever worked in any sort of factory, you’d realise there would be no need to make. This sort of thing happens every day. The people on the floor realise just how stupid and pig ignorant management is, but you can’t tell them that cause, first of all you’ll get fired, but also because it doesn’t really matter, as *their* boss still thinks its a *fantastic* solution and thats all that matters. Once the money is spent, its extremely difficult to tell people they did a stupid thing.
Troy | 17-Sep-08 at 4:43 am | Permalink
You can tell that this didn’t really happen, as a CEO would never approach, much less actually go into a place where real work was being done.
Carlos Villela | 17-Sep-08 at 9:52 am | Permalink
Guys, the point is not whether the story is true or not. For all I care, it’s entirely made up and I am not even claiming any original work, here.
The point is to look at this like an interesting anecdote about solving a problem, and that’s all.
codificando.com » Blog Archive » O Ventilador e o Pirulito | 23-Oct-08 at 4:11 pm | Permalink
[...] alguns meses que os gujeiros Rodrigo Yoshima e Carlos Villela blogaram sobre o uso errado da tecnologia numa fábrica de pastas de dentes. Para resolver o [...]
Dave | 02-Jan-09 at 6:34 pm | Permalink
The story may or may not be factually true, but I can assure you, this happens all the time.
I worked in a factory for three years where they implemented dozens of million dollar solutions that were horribly over-engineered and usually useless. Every time they made a change, the operators would have to re-engineer a solution around it, usually using zip ties and duct tape.
The engineers had a great disdain for the operators and rarely, if ever, asked them how to improve anything.
My favourite was an elaborate contraption to prevent bad parts from entering a bin. If a sequence was not followed, an ear piercing screech would sound. The only person with the key was the supervisor and he was *never* within 10 minutes walk of the thing. Invariably it never actually caught a single bad part and was deactivated out of respect to people’s hearing, in less than two weeks. Price tag was on the order of a three hundred grand and six months work. This is at a company that went to 1 ply toilet paper in the bathroom to save three grand.
I’m still pissed they removed two of the four rotating casters on the racks I used to use. It made it nearly impossible to rotate them 180 degrees.. something I had to do 20 times a day. I ended up nearly breaking my hand when the rack moved in the wrong direction and smashed into a wall. Never once did I have a problem with the old racks.
[root@EGA]# » Blog Archive » links - 20090102 | 03-Jan-09 at 5:34 am | Permalink
[...] done free animated gifs for displaying while an ajax call loads Yellowstone Supervolcano Update Networks Are Smart at the Edges Did This Man Just Rewrite Science? My yearly present to Reddit. My Flowchart of ‘Today was a good [...]
Web 2.0 Announcer | 03-Jan-09 at 10:18 am | Permalink
lixo.org :: Networks Are Smart at the Edges…
[...]problem solving
Saved By: Trevor Hunsaker | View Details | Give Thanks[...]…
Sarah | 06-Jan-09 at 1:03 am | Permalink
EPIC FAILURE! Lol
Darren Chandler | 07-Jan-09 at 12:28 pm | Permalink
Typical rigid hierarchy approach to problem solving. Actually it’s interesting that you consider the factory workers the “edges” of the network (if they are infact your own words). A more evolved organisational culture would incorporate them in the decision making process.
To see where I’m coming from, see this ‘evolutionary order’ of organisation types :
http://www.transcendence.com.au/html/s02_article/article_view.asp?art_id=215&nav_cat_id=218&nav_top_id=84
Carlos Villela | 08-Jan-09 at 1:08 pm | Permalink
Hi Darren,
I meant to use the word “edge” not as a way to imply any marginalization of the workers, but to denote where they are in the topology of the network. In a way, it was a bit of an analogy to the way the internet works; the edges are smart, and the network itself is just one big dumb machine that does one thing well (move packets around). That’s one of the founding principles of the ‘net, and it has certainly worked pretty well.
Compare and contrast with other kinds of networks (telephone networks, for instance, are smart at the switches, meaning there is a ton of innovation that didn’t, and couldn’t happen by improving the telephone itself).
Lovely link by the way! I can already see myself using it in a couple of slides
Recent Links Tagged With "fantastico" - JabberTags | 09-Jan-09 at 8:19 am | Permalink
[...] Comment on Memorable Olympic Moment #1 by Ms Fantastico Saved by LisaMD4414 on Sun 28-12-2008 Networks Are Smart at the Edges Saved by driven23 on Fri 26-12-2008 News: Moved To HostGator And New Blog Theme Saved by [...]
vândpupăză » Blog Archive » Principiul KISS | 13-Jan-09 at 9:57 am | Permalink
[...] un articol care ilustreaza foarte bine principiul KISS (Keep It Simple, [...]
O Ventilador e o Pirulito | Planeta Globo.com | 16-Apr-09 at 5:07 am | Permalink
[...] alguns meses que os gujeiros Rodrigo Yoshima e Carlos Villela blogaram sobre o uso errado da tecnologia numa fábrica de pastas de dentes. Para resolver o [...]
#!/bin/mkhl --soup | 10-Jun-09 at 11:48 am | Permalink
““That’s some money well spent!” – he says, before looking closely at the othe…”…
“That’s some money well spent!” – he says, before looking closely at the other statistics in the report….
nuclear powered soup | 10-Jun-09 at 2:42 pm | Permalink
Networks Are Smart at the Edges…
(via mkhl)…
World’s Strangest | A Simple Solution | 13-Jun-11 at 1:41 pm | Permalink
[...] Whether the story is true or not, it illustrates the importance of thinking simple when possible. Link -via a comment at Hacker [...]
» A Simple Solution stuff i like | 13-Jun-11 at 3:56 pm | Permalink
[...] Whether the story is true or not, it illustrates the importance of thinking simple when possible. Link -via a comment at Hacker [...]
SystemEngineer | 13-Jun-11 at 8:32 pm | Permalink
Assuming this entire story is true (well, for that matter, even if it ISN’T true)…
This is all great, until the desk fan blows an empty carton onto the tube sealing machine, which causes the entire factory to go up in flames, destroying the business and livelihood of all of its employees.
This is much akin to a “smart” end-user “innovating” by putting a Linksys wireless access point at their desk, so they can work around the office on WiFi. Without the proper controls, this can lead to easy back-door entry points into corporate networks. Yes, the leaf-nodes can be smart, but they can also be ignorant of the larger picture…something which the engineers are usually acutely aware of.
And as for the network as a whole being a big, dumb machine, I have serious questions as to your expertise in this matter. If you’ve ever seen how a routing table is computed and maintained, or how networks are meshed together to ensure availability, speed, and accessibility, I think you’d change your mind VERY rapidly on how “dumb” they are.
La solución más simple es la mejor — Tecnoculto | 08-Jul-11 at 6:19 am | Permalink
[...] Fuente [...]
La Historia de la Fábrica de Pasta Dental (sobre las soluciones simples) | 20-Jul-11 at 3:05 pm | Permalink
[...] lixo.org – vía By: Juan Fernando Zuluaga C. Category: inspiración Tags: fábrica, historias, [...]
links for 2011-07-29 | Michael Ong | On9 Systems | 30-Jul-11 at 12:26 am | Permalink
[...] lixo.org :: Networks Are Smart at the Edges (tags: business productivity leadership planning) [...]