YouTube Test & Compare: how to A/B test three thumbnails
Use YouTube's Test & Compare to upload three thumbnails to one video and let watch time pick the winner: step-by-step setup, how long it takes, and how to make the three thumbnails actually different.
There's no point arguing about which thumbnail is better any more. YouTube's Test & Compare lets you upload three thumbnails to a video, rotates them across viewers and crowns the one that brings in the most watch time. No guessing — viewers decide.
Step by step
- YouTube Studio → Content → open the video.
- In the thumbnail section, choose Test & compare.
- Upload three thumbnails (1280×720, under 2 MB).
- Save. The test starts right away; it works on new and old videos.
- When it's done, Studio shows the winner and each thumbnail's share of watch time. The winner stays on automatically.
Why watch time?
Because a thumbnail that gets clicked a lot and closed within three seconds poisons your video. YouTube is looking for the thumbnail that earns the click and then keeps the viewer watching. It measures the balance between "over-the-top" and "honest but boring" for you.
The real mistake: three colours of one thumbnail
Most channels trying Test & Compare upload three colourways of the same design: red background, blue background, yellow background. Even if one wins, it doesn't teach you much.
We build the three as three separate ideas:
- A — Promise: what does the viewer get? For Per Regna: "FROM ONE WORLD — to a star empire".
- B — Number: one striking figure. For the same game: "×1000 SHIPS".
- C — Curiosity / conflict: a question or tension the video resolves. "ALONE YOU LOSE."
Whichever wins, you learn something about your audience: do they respond to promises, numbers or curiosity? You push that direction on the next video.
A note for small channels
A test needs impressions to conclude. A video getting a few hundred impressions a day will run longer or end with "no clear winner". That's fine: if the difference is small, keep the one you like. Preparing three different ideas still beats locking into one.
Our thumbnail sets
Ferrari vs Lamborghini was delivered with three thumbnails plus two alternates. You can see our three-way sets for Per Regna, the noir documentary, the stickman video and a parenting channel side by side on the YouTube thumbnails page. For sizes: YouTube thumbnail size 2026.
Three thumbnails built on three different ideas for one video. Upload them to YouTube’s Test & Compare and let viewers pick the winner.
What’s in it 5
- 3 thumbnails, 3 separate hypotheses (promise · number · curiosity)
- 1280×720, under 2 MB, JPG + PNG
- Legibility check at phone size
- Title suggestion that doesn’t repeat the thumbnail
- Layered source file
Frequently asked
1.What is YouTube Test & Compare?
A built-in A/B test in YouTube Studio that lets you upload up to three thumbnails to a video and rotates them across viewers. It picks the winner by share of watch time and applies it permanently.
2.How long does a test take?
It depends on how many impressions the video gets; usually a few days to two weeks. Low-traffic videos may end without a clear winner, and YouTube reports that too.
3.Why does it pick by watch time instead of click-through rate?
A thumbnail that gets lots of clicks and instant exits hurts the video. Watch-time share rewards the thumbnail that both gets the click and keeps its promise.
4.What makes a good set of three?
Three different ideas, not three colours of one design: a promise (what the viewer gets), a number (one striking figure) and curiosity or conflict (a question the video answers).
