The Official YouTube A/B Testing: Everything We Know in 2024

The Official YouTube A/B Testing: Everything We Know in 2024

Why choose Oona if YouTube is launching an official A/B testing feature? Here are the top 5 reasons.

Feb 15, 2024

It’s no secret that A/B testing is the key to success for YouTube creators. YouTube is developing the feature as we speak and it’s fair to ask why we need a third-party A/B testing tool like Oona. We’ll tell you all about it in this article.

The Official YouTube Announcement

YouTube announced the official thumbnail A/B testing feature back in June 2023. It’s still in beta and only invited creators have the access to try it.

A/B testing feature announcement Source: YouTube

The feature includes:

  • Up to 3 thumbnails: you can test up to 3 thumbnails at once.
  • The winner: the winning thumbnail is automatically announced and set as default.
  • Watch time percentages: tells you the proportion of the watch time each thumbnail contributed to the video.

Words on The Street

A recent thread on Reddit uncovered the beta experience with the A/B testing feature. To summarize it:

  • The thumbnail A/B testing is not available for live videos.
  • You can’t manually set the test duration
  • The only stats available to you is the watch time percentages
  • You don’t have the visibility over how the test is running
  • Title A/B testing is not available

The feature is undoubtedly valuable for creators who’re new A/B testing, but it’s not hard to spot the shortcomings. The lack of control and data available to the creators makes it tough to learn more about the tests and make active decisions on the thumbnails.

Why Oona?

We designed Oona for creators who want more!

We’re dedicated to empower you to make data-driven decisions accurately and quickly so you don’t miss out on your potential to grow your channels. While YouTube thumbnail A/B testing is a valuable tool for general purposes, Oona offers:

❤️ Advanced statistics and machine learning model

To give you clarity on not just which thumbnails or titles worked better in the past, but what will perform better in the future.

⏳ Hourly thumbnail A/B test

You don’t have to wait for days or weeks to get results. We can get you the results in hours!

📝 Title A/B test

Testing titles is important to save underperforming videos. We get that, so we designed the title test to help you achieve your goal while minimizing the impact of changing titles.

🔮 Data transparency

You have total visibility into how the tests are running and all the data that Oona is processing to help you better understand the test results and make well-informed decisions.

🚀 Rapid product development

Oona grows with you. It’s our commitment to build impactful features with lightning speed.


So, why did we build these advanced features? Is the official A/B testing not good enough?

We build Oona because you want to be in control when it comes to making decisions.

When running A/B tests with Oona, you see everything and have full control on the tests. You’ll know how the tests are progressing every hour or everyday and the data that goes into the test results. On top of that, you’ll have a beautiful dashboard to interact with. ✨

Oona's daily CTR chart

If you want to give Oon a try, we’re offering a 30-day free trial. No credit card required. Sign up now.


Cheers,
Daw-Chih


Daw-Chih Liou

Daw-Chih Liou

Founder & CEO of Oona