Validation Pass Marks: When Is an Idea Validated?
Without pass marks set in advance, every result looks like a reason to keep going. Decide what ‘validated’ means before you start, then let the evidence make the call.
When is a startup idea validated?
An idea is validated when it meets pass marks you wrote down before testing: for example, a repeated, costly problem in one segment, a demand test that converts at your target rate, a number of strong commitments such as paid pilots, and a reachable market large enough to matter. If it misses, change something or stop.
How do you set pass marks?
Set one pass mark for each type of evidence, based on your business model: a high-price B2B product needs fewer, stronger commitments than a low-price self-serve one. The example below is for a fictional B2B product; your numbers will differ.
| Evidence | Example pass mark (fictional B2B product) | Where it’s tested |
|---|---|---|
| Problem | 12 of 20 interviews in one segment describe a recent, costly event | Discovery interviews |
| Demand | At least 10 booked calls from a small targeted ad test | Ad tests |
| Commitment | 3 paid pilots or 5 signed letters of intent | Pre-selling |
| Market | At least 5,000 reachable companies at the tested price | Market sizing |
| Message | One headline clearly outperforms the others on booked calls | Smoke tests |
How do you score the results?
Score each pass mark as met, close or missed, using only strong evidence. The example scorecard below shows a fictional idea that has a real problem and a reachable market but weak commitment, which points to changing the offer rather than stopping.
| Evidence | Pass mark | Result | Score |
|---|---|---|---|
| Problem | 12 of 20 | 14 of 20 | Met |
| Demand | 10 calls | 8 calls | Close |
| Commitment | 3 pilots | 1 pilot | Missed |
| Market | 5,000 companies | 7,500 companies | Met |
| Message | Clear winner | Clear winner | Met |
How do you decide what to do next?
Build when all the pass marks are met, or close with a clear reason. Change when the problem is real but demand or commitment falls short: adjust the segment, offer or price and run another round. Stop when the problem itself doesn’t hold up after narrowing the segment. Set a limit on rounds so validation doesn’t become a way to avoid deciding. Real signals vs false positives helps you score honestly.
| Result | Decision |
|---|---|
| All met | Build the smallest product that delivers the result |
| Problem met, demand or commitment missed | Change segment, offer or price; test again |
| Problem missed after narrowing | Stop, or pick a different problem |
Set the bar first.
Pass marks written after the test always get passed. Write them before, and let the evidence decide.
What happens after you decide to build?
Move to the smallest product that delivers the result: what an MVP is and what it costs. Keep the evidence: your pass marks, scorecard and buyer quotes become your first go-to-market plan and investor story. If you want an outside view of the evidence, start with the validation steps and the service below.
Frequently asked questions
How do I know my startup idea is validated?
When it meets pass marks you set before testing, for problem, demand, commitment, market and message.
What is a validation pass mark?
A threshold written down before testing, such as three paid pilots or ten booked calls from a targeted ad test.
How many paid pilots validate a B2B idea?
It depends on deal size and model. Set the number in advance; a few paid pilots is strong evidence for many B2B products.
What if my idea is close to the pass mark?
Look at why. If the problem is real, change the offer or segment and run another round.
When should I stop testing an idea?
When the problem doesn’t hold up after narrowing the segment, or after the number of rounds you set in advance.
Can I change my pass marks?
Only with a written reason, and treat that round as inconclusive.