Architecting A Win/Loss Program To Meet Your Goals

To optimize both the accuracy and efficiency of your win/loss program, we recommend using a mixed methods design.

Mixed methods designs have become a best practice in many types of research. They often combine interviews (for depth) with surveys (for breadth and efficiency).

This qual-quant combination is a good framework for Win/Loss Analysis, too. Win/loss programs have a lifecycle, alternating between periods of broad and narrow change. This is why a mixed methods design is such a good match.

(Check our Win/Loss Analysis definition to see how we define it, and why you should consider upgrading your program.)

Introducing The Win/Loss Lifecycle

A new or upgraded win/loss program is often initiated with expectations of broad change, because it’s been triggered by a painful issue like early stage losses.

This initial period of broad change is followed by a longer period of narrow change, when the program is used to track the impact of the initial changes and identify other areas of improvement.

This is the Win/Loss Lifecycle.

Programs for Win/Loss Analysis must be flexible, to support these alternating periods of broad change and narrow change (as shown in the wave graphed below).

Where Are You Positioned On The Win/Loss Lifecycle?

Broad Change: You’re in a phase that requires broad change if you will use the loss insights to fix issues that are verifiably affecting the company’s revenue; that require substantial cross-functional effort; or that have become high profile by virtue of previously unsuccessful attempts to solve them.

For example, early stage losses is a topic I speak with people about a lot. Fixing this can require changes to product, positioning, pricing, packaging, or sales process. Initiating substantial, cross-functional change like this requires insights that are incontestable. Totally trusted; no doubts; no arguments; just action.

Narrow Change: You’re in a phase of narrow change if the team sponsoring the research will use the loss insights to make incremental improvements. Updating battlecards and positioning based on the latest competitive intelligence, for example. Or improving the sales motion based on buyer feedback about the sales experience.

The Optimal Win/Loss Program Combines Methods For Both Broad And Narrow Change

You can optimize both the accuracy and efficiency of your Win/Loss program by combining multiple methods for data collection and analysis. Use a lower fidelity, lower cost method as the foundation for your program, and supplement it with a high fidelity, higher cost method during periods of broad change.

 

As the foundation for your Win/Loss program, choose a data collection method for narrow change. These techniques maximize efficiency first, then accuracy. In the cell labeled “Narrow Change,” these three methods do the best job of this:

• • Buyer survey run in-house
  • Sales survey run in-house
  • CRM Closed/Lost reasons

Then, when troubling data is flagged by the narrow change baseline—or at least once per year—supplement with a broad change method that provides the highest fidelity insights. For example, your buyer survey may reveal increasing losses to an emerging competitor. Or you may see a downward trend in buyer satisfaction with the sales experience.

During a phase of broad change, use data collection methods that first maximize accuracy, then efficiency such as:

• • Outsourced buyer interviews with a clustered model
  • Outsourced buyer surveys

Outsourced buyer interviews with a subscription model have a Goldilocks problem that impairs accuracy, making them inappropriate for a broad change Win/Loss program. Analysis and reports are based on either too few deals, just 5 or 10 in the past quarter. Or, they’re based on a larger group of 20-40 deals that are 3 or 4 quarters old.

We’ve identified two broad/narrow combinations that optimize both accuracy and efficiency. They’re marked with green dots in the chart.

• • Clustered buyer interviews and buyer surveys
  • Clustered buyer interviews and CRM Lost Reasons

A Mixed Methods Approach To Win/Loss Analysis Is Best

While it’s true that buyer interviews can yield the highest fidelity, most accurate data, they’re also the most expensive approach to collecting Win/Loss data.

The optimal mix of accuracy and efficiency is achieved by Win/Loss programs that combine multiple methods of data collection and analysis.

For example, a Win/Loss program that utilizes Buyer Surveys as its foundation and supplements with Clustered Buyer Interviews will be responsive to changing needs over the Win/Loss Lifecycle. (This combination is marked with a green dot in the matrix.) And at the same or lower cost than a baseline set of twenty buyer interviews.

We detailed the pros and cons of four common data sources here.