Types of Experiments

Created by LiRou C, Modified on Wed, 27 Dec 2023 at 01:07 AM by LiRou C

In Mida, you can create four types of different experiments:

1. A/B Experiment (or A/B/n test)


A/B experiment lets you test different versions of a webpage using Mida's built-in visual or code editor. All the changes made by Mida's editor are hosted by us.


To create an A/B test, you load the original page into the editor. Then, you make changes to create variation(s) - for example, editing the headline, images, buttons, etc.


The original unmodified page is the "control." The edited page are "variations." You can create an unlimited number of variations in your A/B test. So you may have an A version (original), B version, C version, D version, etc. That's why these tests are sometimes called A/B/n tests - because n represents an unlimited number of possible variations. Mida splits traffic evenly and tracks engagement, conversions, or other metrics.


At the end, Mida tells you which variation performed best.



2. A/A Testing:


A/A testing involves comparing two identical versions of a page or experience. It's used to validate your A/B testing setup before running actual experiments.


The goal of an A/A test is to confirm there are no significant differences between the control and variation. If you see major deviations, it likely indicates a problem.


Key uses of A/A testing:

  • Establish a baseline conversion rate for future experiment analysis
  • Determine minimum sample size needed to achieve statistical significance
  • Validate accuracy of your A/B testing tool's statistics and segmentation
  • Confirm integration with analytics to ensure proper tracking
  • Catch technical issues like implementation errors or cookie conflicts
  • Benchmark performance of pages/funnels before making changes


In short, A/A testing is an important diagnostics step when establishing a new experimentation program. It builds confidence in your tools and processes before running high-impact tests.



3. Content Personalization:


Web content personalization with Mida means making your website more relevant to individual users. 


In essence, you're customizing the content to match the needs or interests of your users, based on things like their location, UTM tags, the device they're using, or their past behavior on your site. 


By using Mida's built-in editor, you can create and launch personalized content, providing each user with a unique and engaging experience on your site.



4. Split URL / Redirect Test:


Split URL testing is a method of testing where two entirely different versions of a webpage, each located at different URLs, are compared to see which one performs better. Visitors are directed to different URLs randomly, and the page that generates better results is considered the winner.


The process is similar to A/B testing; both involve showing random website variations to visitors and measuring which one improves the set goals. However, the main difference is the scale of the changes. A/B testing typically involves changing individual elements on a single page, while split URL testing is used for major changes, such as a complete page redesign.


In A/B testing, variations are created within the Mida platform using built-in editors, whereas in split URL testing, you create the variations on your website admin platform. Mida then uses different URLs to load these variations. At the end of a split URL test, you'll need to implement the winning page on your site.



Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select atleast one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article