The Oscars, An Embarrassing Preventable Error, #Lean, and Process Improvement

18
22

Alternative headline: “Poorly Designed Card Trips Up Beatty and Dunaway at The Oscars.” Or “A Bad Process Beats Warren Beatty Every Time.”

I'm in the Los Angeles area for some consulting work the next few days. I was happy that traffic from LAX seemed light because everybody in this area was home watching the Academy Awards on TV, or so it seemed.

I was with a colleague in the hotel bar when the chaos surrounding the Best Picture announcement took place:

Oscars: Warren Beatty and Faye Dunaway Announce Wrong Best Picture Winner

Ah, that headline illustrates the tendency to ask “who?” instead of “why?”

In the “Lean management” approach, with roots in Toyota, the thought process is to look at systems and processes, rather than jumping to blame individuals (see this post, for example, or these others). The late quality guru W. Edwards Deming taught this as, well.

I'm sure you can find video of this on YouTube.

What Happened?

Note: I wrote and updated this post about a dozen times over an hour as new facts and insights came to light. That's not unusual when doing “root cause analysis” or “process improvement.”

This Variety article has video embedded, including the moment when the error was detected:

As this article says:

“There's commotion among the people standing behind him as a man wearing headphones appears and checks red envelopes being held by producers.”

Host Jimmy Kimmel asked, I think half jokingly, “Warren, what did you do????”

Ugh, more blame!

Somebody else is heard saying, during the confusion: “They read the wrong thing.” That's a factual statement. But, if the emphasis is on THEY, it's a blame statement. The real question is why the “wrong thing” was in their hands. Don't blame Beatty and Dunaway…. blame the process. Who designed this process? PWC? The Academy?

PricewaterhouseCoopers has apologized, by the way. PWC says they will investigate. I hope they ask “why?” and “how?” more than “who?” The Academy did not issue a statement.

Beatty explains what happened:

In the hour since this happened, it seems clear that Beatty and Dunaway didn't misread the card… it seems like they had the wrong envelope.

I see two different red envelopes/cards on stage during the chaos that occurred when they discovered the wrong winner had been read:

This tweet suggests that Emma Stone's winner card wasn't handed to her (is that the normal process?):

But Emma Stone said she was holding her winner's card… so was there NOT a card on stage that said “Emma Stone” when Beatty and Dunaway read it? Or there was a duplicate? How confusing.

Perez Hilton tweeted that the accountants, PWC, always have two sets of cards. I wonder why?

Having to “make sure” you're giving the right card to a presenter is also an accident waiting to happen, just as if a hospital tells nurses to “make sure” they are giving the right medication to a patient. Proper error proofing makes it difficult or impossible to do the wrong thing. That's a matter of system design, not “being more careful.”

This same thing about the dual cards was confirmed by a Facebook friend from LA who works in the entertainment industry:

Problem Solving and Prevention

When a mishap occurs, the key in a Lean mindset is to figure out why and how the problem occurred and then put “corrective action” in place to prevent future occurrences. Healthcare is still learning how to get good at this process, so they don't repeat the same mistakes over and over.

When the actor Dennis Quaid's twins were harmed by medical error, it was the exact same problem that occurred at other hospitals before, but healthcare (as a whole) didn't do enough to prevent future occurrences. They eventually did change the medication packaging, which is a good example of systemic improvement.

In a Lean culture, we make it hard for people to do the wrong thing… it's called “mistake proofing” or “error proofing” (read more about this).

In the problem solving process, we might ask “who, what, when, where, why, and how” — but the “who?” is more about “who was involved?” or “who discovered the problem?” not “who screwed up?”

In some of the initial local news reports, I give them credit for thinking about preventing future mishaps like this:

Good problem solving would ask how this happened. Was the Best Actress card with Emma Stone's name really left up on the podium?

If Beatty and Dunaway were confused because they saw “Emma Stone” and “La La Land” instead of just a movie's name, I wonder why didn't “pull the andon cord” (as we'd say in the Lean approach) and ask if something didn't seem right… they were only on TV in front of a global audience, so I understand the hesitance to say, “Hey, something is confusing here.”

Another Lean guy asked the same thing:

A “Lean culture” makes it safe for people to speak up without fear of being blamed or embarrassed. But again, most of us don't have the pressure of working on live TV.

Beatty did explain that he was a bit confused when he looked at the envelope… “that's why I looked at Faye,” but he didn't directly ask the producers something for help.

Somebody on ABC later said, “He was intentionally delaying and hoping somebody off stage would come in and help.” Good theory. But, the help came too late (in a Lean culture, the help comes immediately when you have a concern).

This tweet says Beatty whispered “it says Emma Stone”:

When I rewatched it, Beatty pulls out a card, looks at it (realizing it's wrong?), and then looks in the envelope as if there was going to be another card in there… the right one?

Apparently, it was the “Best Actress” envelope that he was holding… oops, that's a process problem. How was that card even up there? Was it on the podium? Handed incorrectly to Beatty as they walked out?

Here is the card that was supposed to have been read:

As I tweeted, “Best Picture” is in very small text at the bottom of the card… not the best possible design. That's like putting a medication name in really small letters on a bottle… a bad idea that's prone to error.

I'm jumping to solutions without fully understanding the current state process. but I think there's less risk of somebody accidentally reading “The Emmy goes to…” on this night. It should say “BEST PICTURE” in really big letters on the top of the card perhaps.

If Beatty and Dunaway had opened an envelope with a card that said “BEST ACTRESS” on top, would it have been much more clear that it was the wrong card? I think so.

I saw a good question about why this process isn't more electronic? Would that make it easier to “error proof” the process, or would that be prone to hacking?

https://twitter.com/want_to_know/status/836182427974295552

What do you think? I won't be able to update this post during the day Monday as more details come out, so feel free to post comments.

I wish I could be there at “the gemba” to help do proper root cause analysis and process improvement. I'd be happy to have The Academy hire me to help them with processes for 2018… :-)

Watching again, I see the confusion on Beatty's face that was hard to pick up on real time (and I was only half watching). It was a but unfair to make Dunaway read the card, eh?

Are you able to use this mishap as a way of talking about errors, process, problem solving, root cause analysis, and problem prevention?

Scroll down to read updates and more thoughts in the comments section.

Related reading: Here is a post from a year later about their attempts to fix the process:


What do you think? Please scroll down (or click) to post a comment. Or please share the post with your thoughts on LinkedIn – and follow me or connect with me there.

Did you like this post? Make sure you don't miss a post or podcast — Subscribe to get notified about posts via email daily or weekly.


Check out my latest book, The Mistakes That Make Us: Cultivating a Culture of Learning and Innovation:

Get New Posts Sent To You

Select list(s):
Previous articleI Was Asked to Share “Pet Peeves” About Lean (and Lean Sigma)
Next articleWithout Kaizen, There Can Be No Accountability
Mark Graban
Mark Graban is an internationally-recognized consultant, author, and professional speaker, and podcaster with experience in healthcare, manufacturing, and startups. Mark's new book is The Mistakes That Make Us: Cultivating a Culture of Learning and Innovation. He is also the author of Measures of Success: React Less, Lead Better, Improve More, the Shingo Award-winning books Lean Hospitals and Healthcare Kaizen, and the anthology Practicing Lean. Mark is also a Senior Advisor to the technology company KaiNexus.

22 COMMENTS

  1. On LA’s NBC 4 news this morning, they played a clip from a news story they aired yesterday.

    A reporter interviewed the two PWC people who are “solely responsible” for the results.

    The reporter asked what would happen if a mistake was made in reading a winner. The PWC guy, Brian Cullinan, said they would stop the show, make a correction, and clarify.

    Maybe they should have put more thought into preventing the mistake?

    FMEA (Failure Mode Effects Analysis) is a good method for anticipating what could go wrong and PREVENTING it:

  2. More about PWC:

    PricewaterhouseCoopers Brand Takes a Massive Hit

    And

    What Would Happen If A Presenter Announced The Wrong Winner At The Oscars?

    The tally involves enough “redundancies” to ensure accuracy, as does the stuffing of the envelopes. “It’s him checking me and me checking him, and we do it multiple times against each other to make sure that when we leave and are ultimately handing the envelopes to someone, we’re very confident they’re getting the right envelopes and the contents in them are accurate,” Ruiz said.

    Is being careful or triple checking ever as good as mistake proofing?

  3. “It wasn’t Warren Beatty’s fault… he got the wrong envelope,” says the local news guy. I’m glad he isn’t getting the blame.

    They’re also pointing out that it’s good that the error was pointed out and corrected immediately, rather than days later.

    I feel bad for Beatty and Dunaway. It’s a shame that the “Moonlight” team had the focus and attention taken away from them in their shining moment, or what should have been.

    I also agree that the La La Land team was incredibly gracious, considering what they were put through.

  4. PwC in crisis meetings with Academy over 83-year contract following amazing Oscars blunder

    The PriceWaterhouseCoopers auditors responsible for the biggest fiasco in Oscars history had previously boasted that their 83-year-old contract had never come up for tender because they “always” do a good job, it has emerged.

    Brian Cullinan, one of the only two people in the world supposed to know the Oscar winners before the ceremony, had said: “It’s such a long-term relationship that we know intricately how everything works, the timing of it, the process that we use, and they have absolute trust in us and what we do.”

    You can’t win back that trust.

  5. When talking about this with my client team today, somebody asked a good question:

    When the wrong winner was read, the PWC people in the wings KNEW a mistake had been made.

    Why didn’t they run out there to “stop the line” before the La La Land team got up there to start their speeches?

    That sounds like a really slow response, especially considering how they had thought through what to do if the wrong name was made. I haven’t timed it, but was it 2 or 3 minutes before they “pulled the andon cord” in a proverbial sense?

    • From this article:

      Why did it take minutes to fix the error? “PwC sounded the alarm, but not right away,” Gary Natoli, the telecast’s stage manager, said in a text message. “It wasn’t until just before I jumped onstage that it was confirmed by both Brian and Martha as the winner being incorrect.” Martha L. Ruiz, a PwC colleague of Mr. Cullinan’s who stood on the opposite side of the stage, and Mr. Cullinan apparently needed to find each other backstage to confer before speaking up.

      I don’t understand why they needed to confer. They should have both rushed out on stage, meeting in the middle, to say “Wait!” before the La La Land team was allowed up on stage.

      And Beatty said this about the situation:

      “I read the card that was in the envelope,” Mr. Beatty told reporters on his way to the Governors Ball, a post-show party. “I thought, ‘This is very strange because it says best actress on the card.’ And I felt that maybe there was some sort of misprint.” Pressed further, he said, “That’s all I have to say on the subject.” Ms. Dunaway declined to comment.

      • Here is the timeline from a video I rewatched:

        0:27 announcement of “La La Land” by Dunaway

        0:35 the announcer voice on the broadcast talks about La La Land having 14 nominations… the announcer doesn’t have a script designed around Moonlight for this? The announcer really doesn’t know the winners? Why can’t get an announcer they can trust with the results?

        2:27 finally, producers or somebody comes out on stage

        2:54 the announcement of “there’s a mistake”

  6. More about the one PWC partner apparently being distracted before the moment he gave the wrong card to Warren Beatty:

    PwC Partner at Oscars Tweeted Backstage Minutes Before Best Picture Mix-Up

    Just minutes before he gave Mr. Beatty the wrong envelope, Brian Cullinan, one of two PwC partners working backstage at the show, tweeted a glamorous photo of the actress. “Best Actress Emma Stone backstage! #PWC!” he posted, along with the photo, at 9:05 p.m. Pacific time. About three minutes later, Mr. Beatty and Ms. Dunaway walked on stage to announce the evening’s top prize.

    Mr. Cullinan’s backstage Twitter activity wasn’t sanctioned by the Academy, according to a person familiar with the matter. He’d sought permission to post to social media during the show, but had been turned down, this person added, because his job was only to distribute and verify the envelopes containing the closely guarded names of winners.

    Mr. Cullinan later deleted the tweet, apparently on Monday morning. The Wall Street Journal reviewed copies, including a version publicly accessible on Google’s servers.

  7. I’m just hysterical and laughing at all of the self righteous moronic idiots of Hollywood. The Oscar is nothing more than self appreciation of ‘look at me aren’t I gorgeous!’. The trouble is the moviegoer didn’t vote for any one actor. The Oscar is and will forever be group therapy for the participants seeking self worth. So when something goes wrong, you big shot Hollywood
    Stars are all too quick to hang someone. Where’s love? Where’s the professionalism? All I see is hypocrisy… just proves you are all actors, incapable of real life situations. You people should try walking on water.

  8. From this article:

    The design of the envelopes could have been a factor. The envelopes were redesigned this year to feature red paper with gold lettering that specified the award enclosed, rather than gold paper with dark lettering. That could have made the lettering harder to read. The Academy of Motion Picture Arts and Sciences, not PwC, is responsible for the design and procurement of the envelopes.

    As with many mistakes, there are many contributing causes, not just one single point of failure.

  9. So much in this situation mimics what happens in businesses all the time:

    Mistake happens, no one notices until it is too late. Abbreviated investigation discovers WHO is at the source of the fatal flaw. Final conclusion: “human error.” Solution: “Pay better attention next time” or “Hire better workers.”

    That is not the way Lean works. We carefully look at the combination of process and culture that caused the mistake. None of us have a view of all that goes on backstage… but I can only imagine:

    Chaotic, messy, managers/workers running around, excitement, celebrities. Duplicate envelopes & briefcases (overproduction …. just in case… and both look EXACTLY the same). On top of that, a presentation culture that says, “read the contents of the envelope without hesitation and with personality …. even if you disagree or question the contents.”

    Not an easy problem to fix, but the solution is definitely NOT “pay better attention next time.” I can imagine a (guarded) shadowboard on the wall backstage with a slot for every category envelope. The envelopes get removed from the wall and handed to the presenters. This way many people have visibility of where we are in the program and how many categories remain. If the managers feel more comfortable with backup envelopes, keep them hidden, in a locked box, and make them a different color so that everyone knows if there has been an error in the process.

    Create a culture where presenters could question the results and ask for a confirmation. With a televised time-delay, the world audience would never have to know.

    Find the root cause, discover waste, improve PROCESSES, create a problem-solving culture.

  10. I suggest the following visual references on each envelope to cue the preparers and presenters.
    – Distinct Color Coding of envelopes for each award.
    – Visual Icon (female or male mask for acting, director’s chair for directing, film scroll for editing, etc.)
    – Alphanumeric code on the envelope for sequence and controlled document
    – Orientation to producers, host, and presenters of what to do and how to respond if they get the wrong envelope (troubleshooting and rapid correction)

  11. Hi,

    I personally watched the Osacrs, saw this going down and thought the same thing. I think we can try to avoid it as much as we can, but human error is almost inevitable. Even if we try to use lean tools such as Poka-yoke to avoid errors, there is always a percentage that something can go wrong. this is not only when it comes to people, but even machinery and robot. the only thing we can do is minimize the risks to its lowest rate possible and take the necessary actions to have a contingency plan in case something goes wrong. I do not see a way we can stop human error 100% even if we use the best tools and methodologies out there. Don’t you think so?

    Thank you in advance for any input.

    • Maroua –

      Thanks for your comment… great question. Just because we can’t prevent 100% of human error doesn’t mean we stop trying to improve processes and systems. The Oscars process clearly had a lot of gaps and weaknesses, so there’s much that can be done to make it better. The idea is to work toward perfection, not that we actually expect perfection.

      I use this quote in training a lot:

      “Human error is inevitable.
      We can never eliminate it.
      We can eliminate problems in the system that make it more likely to happen.”

      Sir Liam Donaldson
      WHO World Health Alliance for Patient Safety

  12. Updates and other commentary:

    Oscars 2017: Accountants Responsible For Best Picture Gaffe Will Never Work For Academy Again

    I’m not surprised by this. That would be my decision too. On the one hand, they’re VERY unlikely to make that same mistake again, given the change. But still…

    I’d fault the PWC people for 1) not having a good process and 2) not following their process plans (how to respond after the problem was identified). I wouldn’t necessarily punish somebody for getting a bad result that came from following the process.

    Too often, in healthcare, people don’t follow the process and they still get a good result (they might be lucky). They weren’t lucky this time. That’s why you punish more for choosing NOT to follow the process.

    In Defense of Warren Beatty at the Oscars

    Yes, people need to stop blaming Beatty and Dunaway

    Some of you ageists think Beatty should simply have said, “There seems to be a problem.” But improvisation is not his strong suit and he is not one to blurt out anything publicly, especially this publicly. In the best of circumstances, Biskind says, “Warren is not exactly Demosthenes when it comes to public speaking.” He thinks if Dunaway hadn’t been so quick on the draw, Beatty might have had a moment to collect himself and take the better route.

  13. Another perspective from “the gemba:”

    The Oscars Stage Manager Tells All, Says He Was Stunned by PwC Accountant Incompetence

    “I still do not understand the delay,” Natoli told TheWrap. “Brian should have run out there on his own. Martha should have run out there. I didn’t get on the headset and say, ‘Hey, producers, this is what’s happening. What do we do?’ We took our own initiative and got it done — and if we hadn’t done that, we could have been off the air before it was fixed. I’m proud of the way that we handled it, given the lack of response from PwC.”

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.