If you suspect your appointment setting agency is booking unqualified meetings, check it on paper before you argue about it.
Pull the last 10 to 20 meetings the agency reported and score each one after the fact on six yes or no questions: right person, right company, a problem stated in writing before the booking, attended, counted once, and a next step at the end.
Then split the result into three numbers: meetings booked, meetings attended, and meetings that passed. The share that passed is what you are actually buying, whatever the monthly report says. Budget about an hour.
Under a junk-meeting complaint sit three separate failures, and each points to a different fix. The scorecard tells you which one you have. That decides whether you fix the definition, fix your own sales calls, or start looking at other agencies.
Smirnov Consulting Group is a Prague-based B2B outbound lead generation agency that runs cold email and LinkedIn campaigns for founder-led B2B companies and books qualified sales calls. I run it, so you are reading an agency owner's view of this audit.
Which of three problems is your junk meeting?
A founder who says "the meetings are junk" usually means one of these, and each needs its own fix:
- The wrong meeting. The person had the wrong title, worked at a company outside your market, or never had the problem you solve. That is targeting and reply handling, which is the agency's work.
- The empty meeting. It was booked and nobody came, or they dropped off after a few minutes. That is attendance, and it is shared: the agency set it up, but reminders, the invite and how warm the prospect was all play a part.
- The dead-end meeting. The right person showed up, talked for 40 minutes, and nothing came next. That one can be your problem as much as the agency's.
Getting a meeting booked and getting a contract signed are separate jobs, and an agency is paid for the first one. If the dead-end meeting is your main problem, a new agency will book you more of them.
The trouble starts when a monthly report folds all three into one line. "20 meetings booked." You feel half of them were bad, the agency points at the 20, and the conversation goes in circles because nobody pulled the failures apart.
How do you score the meetings an agency already delivered?
Take the agency's list of meetings for the last month or two. You want 10 to 20 of them. With fewer than 10, a single meeting moves your percentage by 10 points or more.
Open four things next to that list: the reply thread that led to each booking, your calendar, your call notes or CRM record, and the agency's own report. If the report does not show booked and held meetings separately for each channel, ask for a weekly report that does.
Then answer six questions per meeting. Yes or no, no partial credit.
| # | Question | Yes when | A "no" usually points to |
|---|---|---|---|
| 1 | Right person? | The attendee could open a buying decision on their own, without bringing in a boss first | Title filters that are too loose |
| 2 | Right company? | Size, industry and country match your brief, and it is not a customer, a live deal or a competitor | The list source, or an exclusion list you never handed over |
| 3 | Problem stated before the booking? | The reply thread shows the prospect describing a need in their own words, beyond "sure, send a time" | Reply handling that sends the calendar link on any friendly word |
| 4 | Attended? | They joined and stayed for a real conversation; 15 minutes is a common line for a first call | Confirmation and reminders, or a weak first touch |
| 5 | Counted once? | It is not a reschedule reported as a new meeting, and it happened in the month it was reported | How the agency counts and reports |
| 6 | Next step agreed? | The call ended with a proposal, a second meeting or a follow-up date both sides accepted | Fit, or your own sales call; read it next to 1 to 3 |
A meeting passes when it gets a yes on questions 1, 2, 3 and 5. Questions 4 and 6 are counted on their own, because they measure attendance and your sales call.
Score questions 1 to 3 for every meeting on the list, including the ones nobody attended. A no-show can still be the right person at the right company. A wrong person who did turn up is still a wrong meeting.
Question 3 is the easiest one to skip, because it means opening old email threads. It is also the question that separates a real meeting from a calendar slot, and the thread is the only place the answer lives. If the agency cannot show you the replies behind its bookings, write that down as a finding.
How to turn the scores into a number you can act on
Here is the math on one month with round numbers, so you can see how the three rates come apart. It is an illustration of the method, so plug in your own counts.
| Line | Count | Share |
|---|---|---|
| Meetings on the agency's report | 20 | 100% |
| Passed questions 1, 2, 3 and 5 | 11 | 55% of reported |
| Attended (question 4) | 16 | 80% of reported |
| Passed and attended | 9 | 45% of reported |
| Next step agreed (question 6) | 4 | 44% of the 9 |
Look at the fourth line. The invoice says 20. Of those, 9 were the right person, at the right company, with a stated problem, who actually showed up. That 45% is what the month bought you, and it is the number to take to the agency together with the scored list behind it.
It also gives you your real cost per meeting. Divide the month's fee by 9 instead of 20. At a 45% share, each real meeting cost you about 2.2 times the headline price per meeting.
For a reference point on cold outreach: one campaign of mine held 28 of its 34 booked calls, and another held 12 of the 16 it booked in 30 days. That is 82% and 75%, and I would call both good for cold leads. If your attendance sits well under that, look at how meetings are confirmed before you look at who was targeted.
Split attendance by channel if the agency runs more than one. My post on what happens after a call is booked splits one month by channel: cold email lost 5 of its 21 booked calls, and LinkedIn lost 1 of 13. Prospects who had already seen a face and a profile turned up more reliably.
Then follow the passed-and-attended meetings through to signed deals over the next months. My line for a healthy closing ratio on a high-ticket B2B service is 20% of booked calls or more, and the full method is in the guide to meeting-to-close rates.
Run that ratio twice: on everything the agency booked, and on the meetings that passed. In the example month, 2 signed deals would be 10% of the 20 reported meetings but 22% of the 9 real ones. That split says the junk is dragging your number down and your sales call is doing its job.
What should you do with the score?
| What the scorecard shows | What it usually means | What to do this month |
|---|---|---|
| Pass rate close to the reported number, attendance normal, few next steps | The agency is delivering; the gap opens after the booking | Look at your own calls: who takes them, how fast you follow up, what you propose |
| Attendance normal, pass rate well below reported | Targeting or reply handling, often because "qualified" was never written down | Turn the six questions into a written definition and hand over your exclusion list |
| Pass rate fine, attendance low | Booking and reminder problem | Ask how meetings are confirmed and reminded, and split attendance by channel |
| Pass rate and attendance both low | You are paying for volume | Raise it now with the scored list, before any renewal talk, and start comparing other agencies |
The first row is the uncomfortable one. My post on booked calls, linked above, opens with a founder who calls 100 sales calls and 3 signed clients a good quarter. I count the other 97. If most meetings pass and few turn into a next step, a better agency will not change that. Your sales call will.
The second row is the fixable one. Take the scored list into your next call with the agency as a draft definition. An agency doing honest work gains from it, because a written target is easier to aim at than a feeling. How they react to the list tells you a lot.
The fourth row is where you start shopping. Before you sign with the next agency, work through my eight questions for a lead gen agency. Start with a sample of the real list they would build, because question 2 failures show up in a list before the first meeting is ever booked.
Why asking for more meetings makes it worse
The tempting move is to ask for more. If half the meetings are junk, double the meetings and you get twice as many good ones.
It does not work like that. A closing ratio that is low now gets lower when more calls come in. Extra volume reaches colder and more skeptical people than the ones you are already failing to convert, so the weak spot gets wider. Throwing a hundred more calls at a sales problem ends badly.
In that same post on booked calls, I worked through a real month of 78 booked calls and put it this way: "If the same 78 calls yield three, the fix is not another 78 calls."
Junk meetings also cost more than the invoice. Each one takes preparation, an hour of someone's calendar and a follow-up email that leads nowhere.
Selling time is already scarce. Salesforce's 2026 State of Sales research, a survey of 4,050 sales professionals in 22 countries fielded in August and September 2025, put the average seller's share of time spent actually selling at 40%. Every junk meeting comes out of that 40%.
The bigger cost is the blind spot. When a third of your calendar is padding, the pipeline stops telling you whether outbound works. You end up judging the whole channel on meetings that never had a chance.
How to stop junk meetings before the next agreement
The audit is a repair job. The cheaper version happens before the first invoice.
Write the six questions into the agreement as the definition of a qualified meeting. Add a minimum length for attendance and a rule for when a reschedule counts as a new meeting.
Then add a review window: a few business days after every call during which you or the agency may flag a meeting and give the reason. Meetings both sides agree to flag drop out of that month's count.
This is not legal advice. Have your lawyer put it into proper contract language.
Questions founders ask about agency meeting quality
Is a no-show a junk meeting?
Count it separately. A no-show can be the right person at the right company who got busy, and cold outreach loses some booked calls before they ever happen; two of my own campaigns held 75% and 82% of their booked calls. Score it on questions 1 to 3 anyway. If it passes, you have an attendance problem. If it fails, it was junk before anyone missed it.
How many meetings do I need before the audit means anything?
10 to 20. With 10, one meeting is worth 10 points of your pass rate, so treat the result as a direction until you have more. With 20, one meeting is 5 points. If the agency booked fewer than 10 in a month, score two months together.
Should the agency replace meetings that fail the scorecard?
That depends on what your agreement says counts as a meeting. If nothing is written down, there is little to hold anyone to for past months. Use the scored list to agree on a definition and a review window that apply from next month.
