Lion Studios
  • LionSDK Documentation
    • 📦Getting Started
    • Analytics
      • Validation
        • Event Validation
        • Lion Analytics QA Tool
        • Looker Events QA
      • A/B Testing
        • AB Test Tips (Experiment Best Practices)
      • Progression Event
      • Economy Event
      • Monetization Event
      • Advanced Ad Events
      • Interaction Events
      • Social Events
      • Debug Events
      • Other Events
      • Custom Events
      • API
        • Events
          • AbCohort
          • AppOpenShow
          • AppOpenEnd
          • AppOpenClicked
          • BannerRevenuePaid
          • BannerShowRequested
          • CharacterCreated
          • CrossPromoLoad
          • CrossPromoLoadFail
          • CrossPromoShow
          • CrossPromoStart
          • CrossPromoShowFail
          • CrossPromoEnd
          • Achievement
          • CrossPromoClick
          • DebugEvent
          • EconomyEvent
          • ErrorEvent
          • FunnelEvent
          • ShopEntered
          • Options
          • ProductViewed
          • GiftReceived
          • GiftSent
          • Heartbeat
          • ItemCollected
          • InAppPurchase
          • InterOpenStart
          • InterOpenLoadFail
          • InterOpenClicked
          • InterOpenRevenuePaid
          • InterOpenShow
          • InterOpenShowFail
          • InterOpenEnd
          • InterstitialClick
          • InterstitialEnd
          • InterstitialLoadFail
          • InterstitialLoad
          • InterstitialRevenuePaid
          • InterstitialShow
          • InterstitialShowFail
          • InterstitialStart
          • InviteReceived
          • InviteRewarded
          • InviteSent
          • GameStarted
          • FeatureUnlocked
          • NotificationOpened
          • MissionAbandoned
          • MissionCompleted
          • MissionFailed
          • MissionStarted
          • MissionStep
          • LevelAbandoned
          • LevelComplete
          • LevelFail
          • LevelStart
          • LevelStep
          • LevelUp
          • SkillUsed
          • NewPlayer
          • HandAction
          • SkillUpgraded
          • CharacterUpdated
          • PowerUpUsed
          • PredictionResult
          • RewardVideoEnd
          • RewardVideoOpportunity
          • RewardVideoClick
          • RewardVideoRevenuePaid
          • RewardVideoShow
          • RewardVideoShowFail
          • RewardVideoCollect
          • RewardVideoStart
          • Social
          • SocialConnect
          • Support
          • UiInteraction
          • ItemActioned
          • CharacterDeleted
          • AppOpenStart
          • AppOpenShowFail
          • AppOpenLoadFail
          • AppOpenLoad
          • InterOpenLoad
          • RewardVideoLoadFail
          • RewardVideoLoad
        • All Event Parameters
        • Helper Functions
        • Events Embedded
      • Experiment Events
    • Features
      • Remote Configs
        • Balancy Adapter
          • [WIP] - AB Experiments (Balancy)
        • Remote Configuration
        • Firebase
          • AB Experiments (Firebase)
        • Satori
          • A/B Experiments (Satori)
        • LiveOps Remote Config
          • Test Adapter
      • Loading Scene
      • Ads
      • IAP Validation
      • Adapter Stabilizer
      • Cloud Build
      • Options Menu
      • WhoAmI Service
    • Third-party SDKs
      • Amazon Publisher Services (APS)
      • Adjust
      • MAX SDK
        • Max Consent Flow
      • Facebook
      • Helpshift - Customer Support
    • Jenkins Build Server Solution Documentation
      • Administration of Jenkins Slack Trigger
      • Screenshare Into Jenkins Build Agents
      • Common Jenkins Build Issues
      • Jenkins Slack App Usage Guide
    • Detected Issues
      • API Level is too low
      • Publishing Settings Issue
      • Android & iOS Resolver Settings
      • SDK Settings Mismatch
      • Facebook Client Token Empty Issue
      • Adjust Id Empty Issue
Powered by GitBook
On this page
  1. LionSDK Documentation
  2. Features
  3. Remote Configs
  4. Balancy Adapter

[WIP] - AB Experiments (Balancy)

PreviousBalancy AdapterNextRemote Configuration

Last updated 3 months ago

Introduction

  • AB Experiments are set up on the Balancy Dashboard. Ensure your Balancy instance is set up and you can access your Balancy project.

  • LionSDK will automatically fire theab_cohort event to LionAnalytics, allowing us to analyze the experiment results

  • This document explains the requirements using an example use-case.

Pre-requisite

  • Install and setup Balancy in Unity project as explained here

  • Install LiveOps plugin in Balancy game dashboard.

At this point, you will be able to fetch remote configs from Balancy via LionSDK (Remote Config) package.

Requirements

  • Create an experiment with an experiment name by going to your Balancy game dashboard and follow the experiment naming convention

    • Naming Convention → {game_code}_{platform}_{testName}

      • game_code: Three-letter game code (e.g., FNI, SBP, FMT). If the game doesn’t have a three-letter code, use the game name in camel-case: gameThatDoesntHaveCode.

      • platform:

        • ios for iOS

        • and for Android

        • all for tests run on both platforms simultaneously (start and end dates should be equal).

      • testName: Any descriptive name for the test. Please use camel case instead of spaces for multiple words.

Example Use-Case

  • Let’s suppose there is a game with game code csc runs an experiment to evaluate the impact of different interstitial ad timings. The experiment is named csc_and_newInterTimer, with the following variants and configurations:

    Variants
    inter_between_time
    inter_start_time

    baseline

    90

    90

    aggressive

    60

    60

    passive

    120

    120

  • Each variant receives different values for the experiment's inter_between_time and inter_start_time remote configs.

Requirements

  • Create an experiment with an experiment name following the experiment naming convention

    • Naming Convention → {game_code}_{platform}_{testName}

      • game_code: Three-letter game code (e.g., FNI, SBP, FMT). If the game doesn’t have a three-letter code, use the game name in camel-case: gameThatDoesntHaveCode.

      • platform:

        • ios for iOS

        • and for Android

        • all for tests run on both platforms simultaneously (start and end dates should be equal).

      • testName: Any descriptive name for the test. Please use camel case instead of spaces for multiple words.

    • Example → csc_and_newInterTimer

  • Create templates/remote configs that the experiment will override for each experiment cohort

  • Setup the override values for each experiment cohort

For more information on the above, you can follow this link

For more information on Balancy AB test documentation. You can follow this official link

  • Introduction
  • Pre-requisite
  • Requirements
  • Example Use-Case
  • Requirements