Business: Product · Lesson N.prod.6

From draft to testable prototype, in hours

AI builds a clickable prototype in hours, what used to take weeks of design. But too much fidelity fools the test just as much as too little. Deciding what to test, and what can stay fake, is still yours.

Examples for

You have an idea for a new flow to fix a drop in activation, and need something to test with users by Friday. Before, that meant two weeks of design: wireframe, review, high fidelity, clickable prototype. Today AI generates a navigable prototype from a text description, in hours. The problem shows up when the prototype comes out too polished, full of refined visual detail, and the user reacts to the design, not to the idea you wanted to test.

Let me tell you something about prototypes. Before, putting together something clickable to test an idea was the whole process's bottleneck: two weeks of design, handoff, adjustment, just to arrive at a screen a user could actually click. AI changes this radically. It generates the navigable flow from a text description, in hours. Except that speed brings a new trap nobody had before: the prototype can come out too good, and "too good" ruins a test too.

The core idea of this lesson. AI drastically speeds up the mechanical part of building a prototype: generating the screens, the clickable flow, the sample data. What's still yours, and what decides whether the test is worth anything, is choosing the right fidelity for the question you're asking, and making sure the user reacts to the idea, not to visual polish that shouldn't be there yet.

01What AI speeds up: from description to clickable flow

Think about what changed. You describe the flow you want to test, "an onboarding screen with three steps, the second step asking to connect an account", and AI generates the screens, the transitions between them, and even fills in sample data to make it look real. What used to require a dedicated designer for days now comes out as a navigable draft in hours.

That's great, and it would be a mistake not to use it. The speed gain lets you test far more ideas per month than before, and testing more ideas is exactly what separates a product that learns fast from one that takes forever to find out what works.

02The decision that's yours: which fidelity serves this question

Here's the point AI doesn't decide on its own. Prototype fidelity isn't "the prettier, the better". It's "the right level of finish for the question you're testing".

If the question is "does this flow concept make sense to the user", low fidelity is enough, and sometimes it's better: plain screens, with no defined color, no micro-animation, let the user react to the flow's logic, not the visuals. If the question is "is this specific design clear enough", then yes, you go up to high fidelity, because it's the finish itself that's being tested.

low fidelity tests the concept and the flow's logic medium fidelity tests the information's structure high fidelity tests the design and the finish itself AI delivers any level fast; choosing the right level is yours

03The risk: an overly polished prototype distorts the user's reaction

Here lives the new danger that ease brought. Since AI can generate high fidelity almost as fast as low fidelity, the temptation is always to ask for the most polished version, "since it comes out easy anyway". The problem is a well-known research effect: users react well to pretty things, and that positive reaction bleeds into their evaluation of the concept, even when the concept itself has a serious problem. You walk out of the test thinking you validated the idea, when you actually only validated that the design was pleasant.

The opposite also exists and is rarer, but happens: a prototype that's too rough, with no visual cues at all, can make the user get stuck on things that don't matter for the test, like "what color is this button", and never get around to reacting to the idea itself. Your job is to calibrate: enough fidelity to feel real enough and not distract, without polish that isn't the question yet.

Learn more: the "halo effect" in prototype testing

The halo effect is when one good, visible quality (here, pretty design) contaminates the evaluation of another quality you wanted to measure separately (here, whether the idea solves the problem). It's a well-documented bias in user research: people report liking a concept more when it's well designed, even when asked specifically about the flow's logic, not about the aesthetics. The simplest defense against it is to deliberately lower the visual fidelity down to the minimum level that still leaves the flow understandable, especially in the early stages when you're testing whether the concept makes sense, not whether the button looks nice.

04The choreography: from idea to test, with the right script

Put it all together in a four-step flow. First, you decide the question the test needs to answer, "does this three-step flow activate more than the two-step one?", before asking for any prototype. Second, you ask AI for the prototype at the fidelity that question calls for, no more, no less, being explicit: "generate in low fidelity, with no defined color, focused only on the flow's structure". Third, you write the test script with the central question at the center, not generic questions like "did you like it?". Fourth, you audit the result: separate reaction to the concept from reaction to the finish before deciding whether the idea works.

Skipping the first step is the most common mistake. Without a clear question beforehand, you end up asking for the "most complete possible" prototype, because it feels safer, and you throw away the chance to test what actually mattered, fast and cheap.

Do it now

Do it yourself

Take a real idea you want to test, your real task or another one (a new flow, a screen, a feature).

  1. Write the central question the test needs to answer, in one sentence.
  2. Decide the right fidelity for that question: low (tests concept and logic), medium (tests information structure), or high (tests the design itself).
  3. Ask AI for the prototype explicitly at that fidelity, without letting it "improve" on its own into a more polished version.
  4. Write two test-script questions that attack the central question from step 1 directly, avoiding generic questions like "what did you think?".

You just calibrated the test for the right question, instead of asking for the prettiest prototype just because it's now easy to get.

Practice

1. Why can always asking for a high-fidelity prototype, just because AI generates it fast, hurt a test with users?

2. What's the step most people skip when asking AI for a prototype, and that causes the biggest waste of the test?

For the board

On fidelityit is your decision, not a default. High fidelity just because it is fast is not a choice, it is laziness.
On the halo effectthe reaction to the design leaks into the evaluation of the idea. You walk away thinking you validated the concept when you validated the aesthetics.
On the questiondefine first what this prototype has to answer. Without that you ask for the most complete one possible and waste the test.
What did you think of this page?
Would you recommend this page to someone on your team?