Skip to main content
the boring digital co.
BLOG / FRACTIONAL CMO

The vendor scorecard: the simple tool that holds everyone accountable.

A vendor scorecard is a one-page tool that tracks what each marketing vendor promised, delivered, and cost. Here's how to build one and use it monthly.

Jack Gamble Jack Gamble, MBA
Co-founder · Marketing, Operations & Project Strategist

A vendor scorecard is a one-page document that tracks what each of your marketing vendors promised, what they delivered, and what it cost. It turns a foggy relationship into a clear one. You look at the page, you see the truth, and you make a decision.

Most owner-operated businesses I meet are paying three, four, sometimes six outside vendors at once. A web person. An SEO agency. A paid-ads shop. A social contractor. Each one sends a report. None of the reports talk to each other. And the owner is left with a stack of PDFs and a gut feeling that some of this money is working and some of it is not. The scorecard fixes that. It is the single simplest tool I hand a client, and it is the one that changes the most.

What is a vendor scorecard?

A vendor scorecard is a single sheet that lists every vendor, what they were hired to do, what they promised in numbers, and what actually happened. That is the whole idea. One row per vendor. Columns for the money, the promise, and the result.

The scorecard is not a report your vendor sends you. It is a document you own. That distinction matters. When the vendor writes the scorecard, they choose the metrics that make them look good. When you write it, you choose the metrics that tie to your revenue. A vendor might report 40,000 impressions and 2,000 clicks. Fine. Your scorecard asks a different question. How many phone calls. How many booked consults. How many signed clients. The vendor's numbers feed into yours, but yours are the ones that count.

Keep it boring. A spreadsheet works. A shared doc works. You do not need software for this. You need one page you can read in ninety seconds and a habit of updating it every month.

What goes on the scorecard?

The scorecard holds five things for every vendor: the scope, the monthly cost, the promised outcome, the actual outcome, and a status color. Those five columns tell you everything you need to make a keep-or-cut decision.

Here is what each one means in practice.

Scope. One sentence. What did you hire this vendor to do. "Rank us for family-law terms in San Diego." "Run Google Ads for our HVAC install service." If you cannot write the scope in one sentence, the engagement was never defined, and that is problem number one.

Monthly cost. The real number. Retainer plus ad spend plus any add-ons. A San Diego dental practice I worked with thought they were paying $2,500 a month for ads. The scorecard showed $2,500 in agency fees plus $4,800 in ad spend the agency controlled. The true number was $7,300. They had never added it up.

Promised outcome. What the vendor said would happen, in numbers, by a date. "Ten qualified leads a month by month four." If the vendor never promised a number, write "none." A row full of "none" in this column is its own kind of answer.

Actual outcome. What happened, measured the same way. This is where you compare the promise to the result. Same metric, same units. No moving the goalposts.

Status. Green, yellow, or red. Green means delivering. Yellow means watch it. Red means the numbers are not there and the conversation needs to happen.

That is the entire tool. Five columns. One row per vendor. A page anyone in your business can understand.

Why does the scorecard hold everyone accountable?

The scorecard holds everyone accountable because it puts the promise and the result side by side on one page, and neither party can hide from that. Accountability is not about being tough. It is about being clear. Most vendor relationships drift because nobody wrote down what "good" looks like.

When you send a vendor their row from your scorecard, three things happen. The good vendors relax, because now their work is visible and they were doing it anyway. The mediocre vendors improve, because attention changes behavior. And the bad vendors get defensive or vanish, which is the information you needed most.

I ran operations and projects before I did marketing, and the pattern is identical. A project without a scorecard is a project run on relationships and hope. It feels fine until a deadline slips and everyone points at someone else. The scorecard removes the pointing. The row is either green or it is not.

The scorecard also protects the vendor. That surprises people. A good vendor wants a clear target, because a clear target is one they can hit and get credit for. Vague expectations hurt everyone. When a client says "I just don't feel like it's working," a good vendor has nothing to defend against. When the client says "you promised ten leads, we got three, walk me through it," now there is a real conversation with a real answer.

Who should build and run the scorecard?

The scorecard should be built and run by someone who works for you, not for the vendors. That is the whole point. If a vendor builds it, it becomes a report. If you build it, it becomes oversight.

For a lot of owners, the honest answer is that they do not have the time or the vantage point to run it well. You are seeing your law firm from inside your law firm. You cannot easily tell whether $3,000 a month for SEO is a fair price or a bad one, because you have no benchmark. This is one of the clearest reasons to bring in a Fractional CMO. A fractional marketing lead sits above all your vendors, builds the scorecard, runs the monthly review, and translates vendor-speak into plain numbers you can act on. They work for you. The vendors do not.

If you are deciding whether that role is worth it, we wrote about when you actually need a Fractional CMO (and when you don't). The short version: if you have more than two vendors and no one person holds them to account, you probably need the oversight before you need more spend.

You can absolutely run the scorecard yourself. Plenty of owners do. It takes about an hour a month once it is built. The discipline is the hard part, not the spreadsheet.

How do you run the monthly review?

You run the monthly review by updating the actual-outcome column, setting each status color, and having one short conversation about every yellow and red row. Green rows need no meeting. Save your time for the ones that are drifting.

Here is the routine I hand clients.

  1. Pull the numbers. First business day of the month, gather each vendor's report and your own revenue and lead data. Fill in the actual-outcome column.
  2. Set the colors. Compare promise to actual. Green if delivering. Yellow if slipping. Red if the gap is wide or the trend is bad.
  3. Triage. Ignore green. Schedule a fifteen-minute call for each yellow. Schedule a real conversation for each red.
  4. Ask the same question every time. "You said this. This happened. What's the plan to close the gap, and by when." Write the answer in a notes column.
  5. Set a decision date for reds. A red row cannot stay red forever. Give it sixty or ninety days with a written plan. If it is still red, you have your answer.

The magic is in the repetition. One scorecard review is a snapshot. Six of them in a row is a story. You start to see which vendors improve under pressure and which ones make excuses. You see which channels actually feed your revenue and which ones just feed nice-looking dashboards.

When we started with McShanes Solicitors, the first job was not new work. It was building the scorecard and finding out which existing spend was doing anything. Some was. Some was not. The scorecard told us where to cut and where to double down, and the cutting funded the doubling. No new budget required.

What the scorecard won't do

The scorecard will not fix a vendor who is a bad fit, and it will not turn a weak strategy into a strong one. It measures. It does not decide. You still have to read it and act. A perfect scorecard on a shelf changes nothing.

It also will not catch everything in month one. Some marketing work takes time to show up in the numbers. SEO especially. A red row in month two might be green by month five if the plan is sound. Do not use the scorecard to kill patient work early. Use it to tell the difference between work that is building and work that is just spending. That difference is not always obvious in the first thirty days, which is exactly why you run the review every month instead of once a year.

One more limit. The scorecard compares vendors to their own promises, not to what a great vendor could do. A vendor can hit every number and still be leaving money on the table. Judging that requires benchmarks and judgment, which is a different job. It is part of why picking the right kind of help matters in the first place — we broke down the choice in Fractional CMO vs agency: the difference that matters.

Build the scorecard anyway. It is the cheapest oversight tool you will ever own. One page, five columns, one hour a month. It will pay for itself the first time it shows you a number you were paying for and never getting.

— FAQs

Things readers usually ask.

How often should I update the vendor scorecard?
Update it once a month, on the first business day, after each vendor's report and your own revenue data are in. Monthly is frequent enough to catch drift and infrequent enough to respect that some work takes time to show results.
What if a vendor never gave me a numbers-based promise?
Write "none" in the promised-outcome column and treat that as a warning sign. A vendor who will not commit to a measurable target is a vendor you cannot hold accountable, and the empty column makes that visible.
Do I need special software to run a scorecard?
No. A spreadsheet or a shared document works fine. The tool is deliberately simple — one row per vendor and five columns — so the value comes from the monthly habit, not the technology.
Should the vendor build the scorecard for me?
No. If the vendor builds it, they choose the metrics that flatter their work. Build it yourself or have someone who works for you build it, so the numbers tie to your revenue instead of their dashboard.
How long should I give a red row before cutting a vendor?
Give it a written plan and sixty to ninety days, longer for slow-moving work like SEO. If the row is still red after the agreed window with a fair plan in place, you have your answer.
— READ NEXT
— GET IN TOUCH

Want us to look at your site?

A 20-minute call. No pitch. We'll tell you what we'd fix first.

CONTACT US →