Experiment Distribution

Get advanced filtering control over your experiments

This article shows you how to use Taplytics' powerful user-segmentation controls and allows you to target an experiment to a very specific segment of your users.

If you haven't done so already, take a look at how to set up a Visual ExperimentCode Experiment, or Goal.

Introduction

What good is an A/B test if you can't reach the right segment of your users? Taplytics allows you to use all of the information about your user's device, from OS version and device type to app version. We even filter by more advanced information like the device's location, language, and session count.

Sending App User Data

To get the most out of user segmentation, you should send custom "App User" data about your users. Not only will this data help populate your Taplytics "User" page with useful information about your users, but you can also use it to deeply segment your users. Follow the instructions below to set up "User Attributes" for your app.

Segmentation Filters

Choose any of the following segmentation filters for your experiment.

  1. App Version
  2. Custom User Data
  3. OS Type
  4. iOS Version
  5. Android Version
  6. iOS Device Type
  7. Session Count
  8. New Users
  9. Days Since Signup
  10. Days Since Last Session
  11. Age
  12. Gender
  13. Country
  14. Device Language
  15. App Language
Please note that the user must be valid for all segmentation filters to receive the experiment. Applying too many segmentation filters may result in none of your users receiving the experiment.

  1. App Version

    The app version filter lets you filter your users by the version of your app they are running. We highly recommend applying an app version filter to all your visual experiments because your visual elements can change from one app version to the next and Taplytics may have difficulty identifying the same element if it has changed position or appearance across app versions. Apply a filter for code experiments that are equal to or greater than the app version that you used to introduce the code block into your app.


  2. Custom User Data

    These filters are powered by the custom data that your app passes into the Taplytics iOS or Android SDKs. We allow you to select any key value you pass in. Taplytics currently supports any stringnumber, or boolean value. The auto-fill dropdown helps you select data that you have sent to Taplytics.


  3. OS Type

    This filter sets your experiment to distribute to iOS or Android devices. If you add a filter for both iOS and Android (as seen below), your experiment will be distributed to both device types.


  4. iOS Version

    This filter allows you to distribute an experiment to iOS devices running specific iOS Versions. You can also use the operator field to filter devices with greater than or less than a specified iOS Version.


  5. Android Version

    The Android version filter allows you to distribute your experiment to Android devices running specific Android versions.


  6. iOS Device Types

    The iOS device types filter allows you to choose multiple iOS devices to distribute an experiment too. This filter is useful for making UI changes for specific device types like the iPhone 6+.


  7. Session Count

    This filter segments users by number of sessions.  A session is defined by the number of times an app has been opened while remaining in the background for less than 10 minutes. You can use this filter to test changes with your most active users.


  8. New Users

    This filter only distributes the experiment to users on their first app session. This filter is made for testing experiments with new users on their first launch of your app.


  9. Days Since Signup

    This filter distributes your experiment based on when each user signed up. For example, this allows you to distribute an experiment to users who signed up in the last week.


  10. Days Since Last Session

    This filter distributes your experiment based on when each user last opened your app. For example, this filter lets you distribute your experiment to users who haven't opened your app in the last day.


  11. Age

    This filter distributes your experiment to users within a defined age range. Make sure you are sending in the age parameter to the Taplytics User Attributes in the SDK as explained above, or else none of your users may get this experiment.


  12. Gender

    This filter distributes your experiment to users of the specified gender. Make sure that you are sending the gender attribute to the Taplytics User Attributes in the SDK (as explained above) or your users may not receive the experiment.


  13. Country

    This filter distributes your experiment to users in the specified country. Taplytics uses IP location to determine the user's location. As a backup, we also use the country specified by the user's device.


  14. Device Language

    This filter distributes your experiment to users who have set their device's preferred language to the specified language. 


  15. App Language

    This filter distributes your experiment to users who view your app in the selected language. The app language may be different than the device language because your app may not support a user's preferred language and will default to another language, like English.