Why Post-Event Surveys Mislead, and What to Measure Instead

Donald Kirkpatrick's four levels of training evaluation are reaction, learning, behaviour and results. The smile sheet lives at level one, reaction. It is the easiest level to collect and the furthest from the outcome a client is paying for.

Most facilitators know this. They collect level one anyway, because levels three and four take months and access they do not have. So the smile sheet becomes the report card by default. The client renews or does not based on a form filled out in the last five minutes of the day, by whoever stayed to fill it out.

Timing. The form arrives at the end, so it captures how the session ended, not how it went. Kahneman's research on the peak-end rule shows people remember an experience mostly by its strongest moment and its ending. A rough first hour followed by a warm close scores better than it should.

The sample. The people who answer are not the room. The ones who checked out at ten in the morning are often the ones who skip the form, and their silence reads as satisfaction.

The social pressure. The facilitator is often standing right there. People are polite.

Keep the survey if the client wants it, but stop treating it as the evidence. Add two things that do not depend on anyone's memory or manners.

First, what the room did during each part of the day. Was the group facing the front during the framework section, or only during the stories? Did people come back after the break? Did the energy hold through the exercise debrief? Those are observable, and they tell you which parts of your design carry a room.

Second, a real learning check. A short scenario question at the end of a module, or a follow-up task two weeks later, tells you more about level two and level three than any reaction score. It is more work. It is also the only kind of evidence that holds up when a client asks what they got for the money.

Film the room with one wide, steady shot from the front, with the group's consent. Then review it against your agenda. Even a rough pass, checking once a minute how much of the group is facing the front, will show you the shape of the day. You will find the section that always loses people. Every facilitator has one.

Compare parts of the session, not people. You are testing your design, not grading participants.

Then change one thing. If the room drifts every time you hit the model slide, cut the slide in half, or move the exercise in front of it. Run the next session and look again. That loop, design, watch, adjust, is how a good workshop becomes a great one, and none of it depends on a form.

GRW's founder, Ken King, is also the author of The Smile Sheet. Proof of Impact by GRW reads that footage for you. It reads the group as one, never as individuals, and reports part by part a likely range for how much of the room faced the front and how many people were in view. Nobody fills out a form. Nobody is identified.

It is strict about what it will say. A part of the session gets a range only with at least four people in view and about a minute of steady footage, and anything it cannot read is marked not measured. The footage is deleted once the analysis finishes.

For a facilitator or a leadership development firm, that means a report you can bring to the client that shows how the room responded to each part of your program, instead of a stack of smiley faces. Pair it with a learning check and you have evidence a smile sheet was never designed to give you.