Replies and pipeline
Most agency evaluations come down to price and promised meeting counts. The questions that actually predict success are about targeting, sending practices and what "qualified" means, and whether you need an agency at all.
By Satvik Luthra, Founder11 October 202611 min read
Key takeaways
To choose a cold email agency, check three things before price: how they decide who to target, how they protect your sending reputation, and how they define a qualified meeting in writing. Agencies that disappoint usually fail on one of those, and you can spot it during the sales process if you ask the right questions.
This guide is for founders, sales leaders and growth leads deciding how to run outbound. It covers when an agency is the right choice, when software or an in-house approach fits better, and what to check either way.
We build RevFirst, outbound software that starts with your website, so read it with that in mind. The questions apply whichever route you choose.
Any outbound approach, whether agency, software or your own team, can only amplify what already works. Before comparing options, check three things honestly:
If all three are true, outside help can save you months of trial and error. If not, fix those first.
A good agency will tell you this on the first call. That is your first test.
There are three broad ways to run outbound. None is right for everyone; the choice depends on how much control you want, how much time you have, and how much of the work you want to own.
| Cold email agency | Outbound software | In-house (people plus tools) | |
|---|---|---|---|
| Who does the work | The agency's team | The software prepares it; you review and approve | Your own hires |
| Your control | Lower: you review reports and sometimes copy | High: you see and approve companies, contacts and emails | Highest, if you have the expertise |
| Your time | Low day to day | Moderate: reviewing, approving, answering replies | High, especially at the start |
| Speed to first sends | Depends on onboarding | Usually quick once mailboxes are connected | Slowest: hiring, tools and setup |
| What you keep | Depends on the contract | Your profile, campaigns and mailboxes stay yours | Everything, plus the know-how |
| How you pay | Retainer, per meeting or a hybrid | Usually a subscription; some also charge per result | Salaries, plus tools and data |
| Best when | You want a team to run it end to end | You want control without building a stack | Outbound is core and you can invest long term |
Software like RevFirst sits in the middle. It reads your website, suggests target companies, decision-makers and cohorts, prepares the emails, and sends from your own Google Workspace or Microsoft 365 mailboxes only after you approve the campaign. A strategist checks the campaign with you before launch.
If you would rather not review anything yourself, an agency may suit you better. Our comparison with a cold email agency goes into the differences.
Sending emails is the smallest part of the job. A competent agency takes responsibility for the whole chain between your market and your calendar:
Evaluate each part separately. Agencies are often strong at one or two and quietly weak at the rest.
Targeting decides more about a campaign's outcome than copy does. Ask how they will build your list, and listen for whether the answer starts with your customers or with their data tool.
A strong answer sounds like: "We'll look at your best customers and lost deals, write down fit criteria and exclusions, split the market into groups with a shared problem, then build and verify a list against those criteria."
A weak answer sounds like: "Give us your target titles and industries and we'll pull a list." Title and industry filters produce big lists quickly. They also produce a lot of people who were never going to buy.
Ask to see an anonymized ideal customer profile from a past engagement. If they cannot produce one, they probably do not write one. Our guide to building an ideal customer profile shows what a good one contains.
If emails land in spam, nothing else matters, and the problem is hard to see from outside. A dashboard says "sent," and you assume prospects are not interested. Ask specifically:
This is where most agency relationships break down. You expected meetings with buyers; you got meetings with anyone who said yes. The fix is a written definition of a qualified meeting, agreed before the engagement starts:
| Criterion | Example |
|---|---|
| Title and seniority | Head of Sales or above; founder at companies under 50 people |
| Company size | 50 to 500 employees |
| Region | US and UK only |
| Budget signal | Already pays for a related tool or service |
| Problem stated | Describes the problem in their own words on the call |
| Attendance | Meeting held, not just booked, for a minimum length |
Pay attention to booked versus held. An agency paid per booked meeting is paid for calendar invites.
Also agree what the agency is not responsible for: no one outside your company controls whether your team closes. Our guide on what counts as a qualified lead has a fuller checklist.
Then ask for a sample weekly report. A useful one shows volume sent by group of accounts, bounces and complaints, replies by type (interested, objection, referral, not now, unsubscribe), meetings booked and held against the written criteria, and what will change next week and why. Be wary of reports built around open rates; privacy features in major email clients have made opens an unreliable signal.
Agencies commonly use three models. None is inherently better; each creates different incentives.
| Model | How it works | Works well when | Watch out for |
|---|---|---|---|
| Monthly retainer | Fixed fee per month for a defined scope | Targets and criteria are written down and reviewed | Short terms that force a decision before results are possible |
| Pay per meeting | Fee for each meeting delivered | "Qualified" and "held" are strictly defined | An incentive to book as many meetings as possible, regardless of fit |
| Hybrid | A fixed fee plus a fee per qualified meeting held | You want shared risk without rewarding volume alone | Complexity: make sure both parts are clearly defined |
When comparing quotes, check what is included: contact data and verification, domains and mailboxes, copywriting, reply handling and reporting. A low headline price can leave out half of these.
Also think about term length. Outbound usually needs a couple of months of testing before results become predictable, so a one-month commitment often ends just as things start working.
Software is priced differently again, so compare definitions as well as numbers. RevFirst, for example, publishes its plans on its pricing page: Free Forever at $0 with 1 qualified lead a month, Growth at $499 a month with 3 qualified leads included, and Scale at $999 a month with 10 included and LinkedIn outreach and buying signals added.
Additional qualified leads cost $150 each on Growth and $100 on Scale. A qualified lead there means a positive reply showing interest, not a booked meeting, so it sits earlier in the funnel than an agency's per-meeting fee. Whichever route you choose, get the definition of what you are paying for in writing.
The last question is the most revealing. An agency that cannot name a reason to say no will say yes to everyone, including clients it cannot help. And if, after all this, you would rather keep control yourself, software that lets you approve every company, contact and email before it sends is worth a look alongside the agencies on your list.
Free Forever plan
Enter your website and RevFirst prepares your targets and campaigns for you to review, with nothing sent until you approve. Get started for free.