Methodology · 5 min read

Concept Testing

Concept Testing is a research method that shows target customers a short description of a product or offer that does not yet exist and measures how they react to it.

Summarised from SurveyMonkey and Attest · View sources ↓

At a glance

Use this when
You need evidence that target customers want a product, feature or offer before it is built, priced or launched.
What you will work towards
A scored read of customer appeal, clarity and purchase intent for one or more concepts.
Bring to the reading
A specific decision from your work and the customer evidence you have so far.

What it is

A research method that shows target customers a short description of a product, feature or offer that does not yet exist (or exists only as a prototype) and measures how they react. A concept is usually one page or one screen: the problem, the proposed solution, the main benefits, and often a price. Respondents rate it on appeal, relevance to their needs, uniqueness, believability and purchase intent, then explain their ratings in their own words. The method has no single originator; it grew out of consumer goods research and is now standard practice in survey platforms. There are two main designs. In a monadic test, each respondent sees only one concept, which gives the cleanest score but needs a separate sample per concept. In a sequential monadic test, each respondent rates several concepts in random order, which needs fewer people but lets one concept colour the next. Concept testing differs from message testing: concept testing asks whether customers want the offer, while message testing asks which words best describe an offer that already exists.

When to use it

  • Before committing build budget to a new product or major feature, when product and PMM need evidence of demand, not just an internal belief.
  • Choosing between two or three product or packaging ideas aimed at the same segment, where a monadic score per concept gives a fair comparison.
  • Entering a new segment (a market development move), to check that the new buyers want the existing product framed for them before a full launch.
  • Testing a new bundle, tier or pricing model with customers before it goes on the price page.
  • A product team is split on which of several directions to pursue, and a structured customer read would settle the argument faster than more internal debate.

How to run it

  1. Write the decision first. State what you will decide with the result: build or not, which concept to pursue, which segment to lead with. Set the threshold that would change the decision, such as "at least 30% of respondents say they would definitely or probably buy".
  2. Write each concept on one page. Include the problem, the solution in plain language, three main benefits, and a price if price is part of the decision. Keep every concept the same length and format so differences in score reflect the idea, not the writing.
  3. Choose the design. Use monadic when concepts are similar, the stakes are high, or you need a score to benchmark against future tests. Use sequential monadic for early screening of three to five ideas on a tight budget, and randomise the order.
  4. Recruit the right respondents. Screen for the target segment and buying role using your ICP. Aim for at least 100 to 150 qualified respondents per concept in a monadic design; fewer than that and differences between concepts are often noise.
  5. Ask the standard measures. Rate appeal, relevance, uniqueness and believability on a five-point scale, then purchase intent ("definitely would buy" to "definitely would not"). Add one open question: "What, if anything, would stop you buying this?"
  6. Analyse top-two-box scores by segment. Report the share of respondents choosing the top two points on each scale, overall and by segment. Read the open answers for the objections that recur most.
  7. Compare against a benchmark. Compare scores with an existing product tested the same way, or with your own past tests. A purchase-intent score means little on its own: researchers widely agree that people overstate what they will buy.
  8. Hand the result to the decision owner. Give product the scores, the main objections and a recommendation. Feed the winning concept's customer language into positioning and launch messaging.

Cadence & ownership

PMM commonly runs concept tests, especially at growth-stage companies without a dedicated research team, because it holds the segment definitions, the positioning and the launch plan the result feeds. The build decision itself belongs to product. At a scaled company, a consumer insights or user research team may run the fieldwork, with PMM writing the concepts and defining the target sample. Run a test whenever a significant new product, tier or segment entry is proposed; a typical online concept test takes two to three weeks from brief to result.

Example

Fictional accounting software company Ledgerline had two ideas for its next product: an automated cash-flow forecast and a client portal for accountants to share documents. Product leadership was split. The PMM wrote both as one-page concepts with the same structure and a price of £15 a month each, and ran a monadic test with 300 qualified respondents (150 per concept), all small-business owners or finance leads who matched the ICP. The cash-flow forecast scored 41% top-two-box purchase intent and the client portal scored 22%. The open answers showed the portal's problem: most respondents said their accountant already provided one. Product chose the forecast. The PMM reused respondents' phrases, such as "know if I can make payroll in six weeks", in the launch messaging. The forecast launched seven months later and was adopted by 18% of active customers in its first quarter, against a target of 12%.

Pitfalls

  • Taking purchase intent at face value. It is a widely held view among researchers that respondents say they would buy far more often than they actually do. Recovery: compare scores against a benchmark tested the same way, and treat the result as a ranking between concepts rather than a sales forecast.
  • Writing the favoured concept better. When one concept gets clearer writing, a stronger headline or a lower price, the test measures the copywriting, not the idea. Recovery: use one template for every concept, have someone outside the project review them for balance, and test price separately if it differs.
  • Testing with the wrong people. A cheap panel of general consumers will happily rate a B2B finance tool. Recovery: screen strictly on segment, role and buying involvement, and remove respondents who fail the screener or an attention check.

How the ideas connect

Choose where to go next

Make it useful

Bring it back to your work.

Name one decision this guide could help you make. Write down the evidence you need, the output you would produce, and how you would know it was useful.

Check your understanding

Practise applying Concept Testing in five short scenarios.

5 practical scenarios. Choose an answer, explore the reasoning, and revisit the guide whenever you need.

Sources

  • SurveyMonkey, "Concept Testing Methods", a well-documented guide to monadic, sequential monadic and comparative designs; the method has no single originator.
  • Attest, "Survey Templates", including the concept testing survey template surfaced in this knowledge base's source review, showing the standard appeal, uniqueness and purchase intent measures.

← All entries in Market & Customer Understanding · Try the category quiz · Edit on GitHub