Quiet Coaching Cohort? Run an Anonymous Pulse Survey Mid-Program
It is week four of an eight-week cohort. Eleven of twelve people came to the first call. Last night seven did, and four of them kept their cameras off. Nobody has complained. The chat is polite. You tell yourself they are busy.
The thought that keeps you up is a different one: are they getting what they paid for, and will you only find out from the exit form, or from the silence when you open the next cohort?
How should a coach run a pulse survey during a cohort program? Ask early enough to change something. Around a third of the way through, give the group about five anonymous questions about how you are running the program: the pace, the calls, the materials, the support between calls. Say why you are asking and what anonymous means here, give people a few minutes on a live call to answer, then tell the whole cohort within a few days what you heard and what will change before the program ends.
When to send it, the five questions worth asking, what anonymous can honestly mean in a group of eight, and the report-back message that makes people answer the next one.
The examples below are made up to show the reasoning. The timings and group sizes are starting points, not benchmarks, and nothing here is legal or privacy advice.
What ICF says about surveys during a coaching engagement
The International Coaching Federation published a practitioner article on this by Rosemary Hanrahan, PCC, in March 2018. It opens with the sentence this guide is built on:
Surveys are one of the most commonly used methods to determine a client’s needs and expectations prior to coaching, and they can also be used to monitor and assess progress and results throughout the coaching engagement.
Source: Using Surveys in Coaching: 9 Steps from Purpose to Practice, ICF blog.
The article walks through nine steps, from setting a purpose to communicating results. Four of its points matter most for a mid-program pulse:
- Tell clients what the survey is for, and assure them that taking part or skipping it carries no negative consequences.
- Pre-test the questions on people similar to the ones who will answer, so confusing wording shows up before the real thing.
- Self-administered surveys tend to get better response rates when people complete them in a group setting.
- Report the results back. Plain text in a short narrative or a few bullet points is often enough.
The article is about surveys in coaching generally. It does not prescribe a mid-cohort pulse, a number of questions, a week to send it, or a minimum group size for anonymity. Those parts of this guide are working suggestions from us, and they are labelled that way.
What a quiet coaching cohort costs you when nobody says anything
People in a group program rarely complain to the coach. It feels rude in front of the others, and they assume the problem is them. So they drift. They skip a call, then two. They stop opening the worksheet. On the last day they write "great program, thank you" and never come back.
Take a hypothetical coach, Dana, running an eight-week career-change cohort for twelve people. Her exit form tells her the calls ran twenty minutes over every week, the week-two worksheet made no sense without the recording, and the Tuesday evening slot clashed with school pickup for a third of the group. Each of those was fixable in week three. She learns about them in week nine, when the only people left to benefit are strangers in the next cohort.
The cost shows up later and in places that are hard to trace back: fewer people rejoin, fewer refer a friend, a testimonial request goes unanswered, and one person asks for a partial refund. You cannot fix a problem nobody has told you about, and by the time the exit form arrives the people who had it are gone.
There is a second way to get this wrong. If you ask for feedback and then change nothing and say nothing, the group learns that answering is pointless. Only send a pulse survey if you are willing to act on at least one thing it tells you.
How to run a cohort pulse survey in five steps
- Say why you are asking. One or two sentences: this is about how you run the program, it is anonymous, skipping it changes nothing for them, and you will report back on a named day.
- Ask five questions. Two quick ratings and three open questions, written so they cannot be answered with "all good".
- Give it time on a live call. Three minutes at the end of a session, with the form left open for 48 hours for anyone who missed it.
- Read for repeats. Sort what you hear into what you can fix now, what waits for the next cohort, and what you will not change.
- Report back and change something. Tell the whole group what you heard and name one or two changes that start this week.
Pulse survey, check-in or exit survey: which a coaching cohort needs when
These three get mixed up, and mixing them is how a pulse survey turns into homework. They answer different questions.
| Tool | What it is about | Named or anonymous | When | What you do with it |
|---|---|---|---|---|
| Client check-in | One client's progress and obstacles | Named | Weekly or daily | Coach that person |
| Pulse survey | How you are running the program | Anonymous | Once or twice mid-program | Fix delivery for this cohort |
| Exit feedback | The whole experience | Either | At the end | Improve the next cohort |
A check-in has to be named, because you cannot coach someone whose answers you cannot see. A pulse works better anonymous, because the question is about you, and people soften what they say about the person leading the room. Keep them apart. If you need the end-of-program version, we cover it in end-of-engagement coaching feedback.
When to send a pulse survey in a cohort coaching program
Send it after people have seen enough to judge and while you still have enough weeks left to change something. For most programs that lands about a third of the way in.
| Program length | Suggested pulse timing | Why |
|---|---|---|
| 4 to 6 weeks | Once, after the second session | Any later and there is no time to act |
| 8 to 10 weeks | Once, in week 3 or 4 | Patterns are visible and half the program remains |
| 12 weeks or more | Twice, around week 4 and week 8 | The second one checks whether your first changes worked |
| Ongoing group or membership | About once a quarter | Often enough to catch drift without tiring people |
These are starting points to adapt. Two timings to avoid: the hour after a session that went badly, when you will get a verdict on one call instead of the program, and the final week, when what you are really running is an exit survey.
The ICF article notes that web surveys are quick and cheap but tend to get lower response rates, and that self-administered surveys do better when completed in a group setting. So do not email a link and hope. Put the link in the chat during the last three minutes of a live call and stay quiet while people fill it in.
Five questions worth asking in a cohort pulse survey
Five is enough to find a delivery problem and short enough to finish on a phone. Start with the easy ratings and put the harder open questions after them, which is also the order the ICF article recommends.
- Progress rating. "So far, this program is helping me make progress on what I joined for." Strongly disagree to strongly agree, five points.
- Pace. "The pace is: too slow, about right, too fast."
- What is working. "What has been most useful so far?"
- What is in the way. "What is getting in the way of you getting more from the program? Think about the calls, the materials, the timing and the group."
- One change. "If I changed one thing for the remaining weeks, what should it be?"
Leave out anything you cannot act on mid-program, such as the price or the total length. Leave out questions about the client's own results too. Those belong in a named check-in.
Wording traps that produce "all good"
- Leading questions. "How much are you enjoying the sessions?" assumes they are. Ask "How useful are the sessions?" with a full scale.
- Two questions in one. "Are the calls and worksheets helpful?" cannot be answered if one is and one is not.
- Yes or no where you need detail. "Is everything clear?" gets a yes. "What is still unclear?" gets an answer.
Before you send it, do the pre-test the ICF article recommends. Ask a past client or a peer coach to fill it in and tell you which question made them pause. It takes five minutes and usually changes one question.
What anonymous can honestly mean in a small coaching group
In a cohort of eight, you know how each person writes. If someone mentions their night shifts, you know who it is. Promising anonymity you cannot deliver is worse than not promising it, so decide what you can stand behind before you use the word.
- Use a form that records no name, email or sign-in. If the tool attaches answers to a client profile, call the survey confidential, not anonymous, and say who will see it.
- Do not ask for details that narrow it down, such as job title, company or which breakout group someone is in.
- Share themes only. Paraphrase comments when you report back, and only report a theme when more than one person raised it.
- Do not go looking for the author of a harsh comment. The first time you ask "was that you?", the next survey comes back empty.
- Under about five people, drop the claim. This is our working rule, not a standard. In a group that small, use fixed-choice questions only, or ask openly on a call and accept that the answers will be gentler.
If an employer or sponsor is paying for the cohort, settle in advance whether they see the results and in what form. The ICF article says coaching agreements with organizations should include a statement of confidentiality and anonymity. Tell participants the answer before they respond. Our guide to group coaching confidentiality covers the wider agreement.
A script to read out before the survey
"This takes three minutes. It is anonymous: the form does not record your name or email, and I will only share themes, never individual comments. It is about how I am running this program, not about you. If you skip it, nothing changes for you. On Friday I will post what I heard and what I am changing for the weeks we have left."
Reading pulse results without overreacting
Look for what repeats. One sharp comment stings more than five mild ones, and the five are the finding. Put each theme in one of three piles: fix now, fix for the next cohort, or not changing.
- "Too fast" from several people: cut one topic from the next two sessions and open each call with a five-minute recap.
- "Calls run long": send the agenda the day before and end on time, even mid-discussion.
- "I do not know what to do between calls": close every session with one action and post it in the group chat.
- "The same people do all the talking": use timed rounds or pairs for part of each call.
- "The time slot does not work": you may not be able to move it mid-program. Record the calls and add one office hour at a different time.
If fewer than half the group answers, treat that as a result too. Say so on the next call, repeat the script, and give people the three minutes again. For cohort formats in general, see cohort-based learning for coaches.
Close the loop: tell the cohort what you heard and what changes
This is the step that decides whether the survey was worth sending. Report back within a few days, to everyone, in the place the group already reads. Keep it to three parts: what you heard, what you are changing now, and what you are not changing and why.
"Thanks to the nine of you who answered. Three things came up more than once. The pace is too fast, so I am cutting the networking module to one session and starting each call with a recap. Calls have been running over, so from this week we stop at 7:00 sharp. Several of you asked for a different day. I cannot move Tuesdays mid-program, but every call is recorded and I am adding a Thursday lunchtime office hour."
Notice the last line. Saying no with a reason still counts as a reply. Then say the same thing in the first two minutes of the next call, so people who skim the chat hear it too.
Objections coaches raise about mid-program surveys
"Asking will make me look unsure of my own program"
The doubts are there whether you ask or not. Asking in week three reads as someone who cares how the remaining weeks go. What looks unsure is asking and then going quiet.
"I already ask on calls how it is going"
Keep doing it. Just do not expect criticism of the person running the call, in front of the group, from someone who paid to be there. The written, anonymous version reaches the people who say "fine".
"What if they ask for something I cannot do?"
Then say so in the report-back, with the reason. You are promising to listen and respond, not to grant every request.
"They are busy and I do not want to add homework"
Five questions, three minutes, on a call they are already attending, once or twice per program. If it grows past that, it has become a different tool.
Running a cohort pulse in Coachful, and where it stops
Coachful publishes this guide, so read this part with that in mind. You do not need Coachful to do any of the above. A free form tool and a group email will get you through one cohort.
If you run cohorts in Coachful, here is what the product does and does not cover, checked against the product's own code and feature list:
- The cohort itself. Enrolling clients in a group program creates their cohort group, with group chat, a community feed and group video calls. Video calls are part of the subscription, so the live session where you give people three minutes does not need a separate video tool. See group coaching software, coaching program software and video calls for coaches.
- Anonymous polls. You can post a poll in a chat channel or a feed post with the Anonymous Voting setting on and a closing time. Results show totals for each option, not who picked it. That covers the two rating questions.
- Named check-ins. Questionnaires and check-ins are attached to the client record. That is right for coaching each person and wrong for an anonymous pulse, so do not use them for one.
- The report-back. Post it in the cohort's chat channel or the community feed, where the group already is.
Where it stops: Coachful does not have an anonymous free-text survey. For the three open questions, use a separate form with name and email collection switched off and drop the link in the cohort chat. Coachful also will not read the comments for you or decide what to change. If you are still choosing a platform, our comparison of group coaching platforms applies the same criteria to every tool, including Coachful. And if the pulse shows people want to stay connected after the last call, see alumni access after a cohort ends.
Frequently asked questions about cohort pulse surveys
How many questions should a cohort pulse survey have?
About five: two quick ratings and three open questions. That is enough to find a delivery problem and short enough to finish in three minutes on a phone at the end of a call. The ICF article does not set a number, so treat five as a working limit. If you want a sixth question, remove one first.
When is the best time to send a mid-program survey to a coaching cohort?
Roughly a third of the way through, once people have attended at least two or three sessions. In an eight-week program that means week 3 or 4. Programs of 12 weeks or more can run a second pulse around week 8 to check whether the first changes helped. Avoid the final week, which belongs to the exit survey.
Should a coaching pulse survey be anonymous or confidential?
Anonymous if the tool records no name, email or sign-in. Confidential if answers are tied to a client profile, which means you can see who wrote what and promise not to share it. Say which one it is before people answer. In groups under about five, anonymity is hard to keep, so stick to fixed-choice questions or ask openly.
What if only a few clients answer the pulse survey?
Low response is information. If fewer than half the cohort answers, say so on the next call and give people three minutes to complete it live. The ICF article notes that self-administered surveys get better response rates when completed in a group setting. Do not chase individuals, because that undoes the anonymity you promised.
How is a pulse survey different from a weekly client check-in?
A weekly check-in is named and about the client: progress, obstacles, what they need from you. A pulse survey is anonymous and about your delivery: pace, calls, materials, support. In Coachful, check-ins and questionnaires attach to the client record, while polls in chat and feed posts have an Anonymous Voting setting. Use each for its own job.
Can I use pulse survey comments as testimonials?
No. People answered an anonymous question about what to fix, not a request to be quoted. Using their words in marketing breaks the promise you made in the script. The ICF article notes that open-ended answers can provide testimonials for marketing with client consent. Ask for a testimonial separately, by name, at the end of the program.
How often should a coach survey the same cohort?
Once for programs up to about 10 weeks, twice for 12 weeks or more, and about once a quarter for an ongoing group. More than that and response drops, because people stop believing each survey leads anywhere. One survey that visibly changes two things does more than four that change nothing.
