[Huawei Developers] Efnan Akkus:
[IMG="im1"]https://miro.medium.com/max/1050/1*MGD6vqeImlqfSe6K-CWXxQ.png[/IMG]

Introduction

Hello everyone ,

I will introduce you App Gallery Connect A/B Testing in this article. I hope this article will be help you in yours projects

Service Introduction

A/B Testing provides a collection of refined operation tools to optimize app experience and improve key conversion and growth indicators. You can use the service to create one or more A/B tests engaging different user groups to compare your solutions of app UI design, copywriting, product functions, or marketing activities for performance metrics and find the best one that meets user requirements. This helps you make correct decisions.

[IMG="im2"]https://miro.medium.com/max/1050/0*ohXfYjK0rXX753k8.png[/IMG]

Implementation Process

Enable A/B Testing.

Create an experiment.

Manage an experiment.

1. Enable A/B Testing

1.1. Enable A/B Testing

First of all you need to enable A/B Testing from AG Connect .

Process:

1. Sign in to AppGallery Connect and click My projects.

2. In the project list, find your project and click the app for which you need to enable A/B Testing.

[IMG="im3"]https://miro.medium.com/max/1050/0*AamK3OdCFsqJETbC[/IMG]

3. Go to Growing > A/B Testing.

4. Click Enable now in the upper right corner.

[IMG="im4"]https://miro.medium.com/max/1050/0*5Nhg6KZFtPVzscoj[/IMG]

5. (Optional) If you have not selected a data storage location, set Data storage location and select distribution countries/regions in the Project location area, and click OK.

[IMG="im5"]https://miro.medium.com/max/1050/0*ACM9O3Q5WppDoI_n[/IMG]

After the service is enabled, the page shown in the following figure is displayed.

[IMG="im6"]https://miro.medium.com/max/1050/0*hQpRUpwt2GF_zi4u[/IMG]

2. Creating An Experiment

2.1. Creating a Remote Configuration Experiment

Enable A/B Testing

Go to AppGallery Connect and enable A/B Testing.

Access Dependent Services

Add the ‘implementation ‘com.huawei.hms:hianalytics:{version}’ to build.gradle

Procedure

1. On the A/B Testing configuration page, click Create remote configuration experiment.

2. On the Basic information page, enter the experiment name, description, and duration, and click Next.

3. On the Target users page, set the filter conditions, percentage of test users, and activation events.

a. Select an option from the Conditions drop-down list box. The following table describes the options.

b. Click New condition and add one or more conditions.

c. Set the percentage of users who participate in the experiment.

d. (Optional) Select an activation event and click Next.

4. On the Treatment & control groups page, click Select or create, add parameters, and set values for the control group and treatment group.

5. After the setting is complete, click Next.

6. On the Track indicators page, select the main and optional indicators to be tracked.

7. Click Save. The experiment report page is displayed.

2.2. Creating a Notifications Experiment

Enable A/B Testing

Go to AppGallery Connect and enable A/B Testing.

Access Dependent Services

Add the ‘implementation ‘com.huawei.hms:hianalytics:{version}’ to build.gradle

Procedure

1. On the A/B Testing configuration page, click Create notifications experiment.

2. On the Basic information page, enter the experiment name and description and click Next.

3. On the Target users page, set the filter conditions and percentage of test users.

a. Set the Audience condition based on the description in the following table.

b. Click New condition and add one or more audience conditions.

c. Set the percentage of users who participate in the experimentand click Next.

4. On the Treatment & control groups page, set parameters such as Notification title, Notification content, Notification action, and App screen in the Set control group and Set treatment group areas. After the setting is complete, click Next.

5. On the Track indicators page, select the main and optional indicators to be tracked and click Next.

6. On the Message options page, set Push time, Validity period, and Importance. The Channel ID parameter is optional. Click Save.

7. Click Save. The experiment report page is displayed.

3. Managing An Experiment

You can manage experiments as follow

Test the experiment.

Start the experiment.

View the experiment report.

Increase the percentage of users who participate in the experiment.

Release the experiment.

Perform other experiment management operations.

3.1 Test The Experiment

Before starting an experiment, you need to test the experiment to ensure that each treatment group can be successfully sent to test users.

Process

Go to the A/B Testing configuration page and find the experiment to be tested in the experiment management list.

Click Test in the Operation column.

[IMG="im7"]https://miro.medium.com/max/1050/0*O2WC8VekwDKQkJ3L[/IMG]

3. Add test users.

If you have not test account you need to create one.

[IMG="im8"]https://miro.medium.com/max/1050/0*30Lp1QMwteOMQzVy[/IMG]

If you have test account you need to select experiments and keep going.

[IMG="im9"]https://miro.medium.com/max/1050/0*n0mvw0lVWX-687zS[/IMG]

3.2 Start The Experiment

After verifying that a treatment group can be delivered to test users, you can start the experiment.

Process:

Go to the A/B Testing configuration page and find the experiment to be started in the experiment management list.

2. Click Start in the Operation column and click OK.

[IMG="im10"]https://miro.medium.com/max/1050/0*YuZuFrq3lHmlsH7t[/IMG]

After the experiment is started, its status changes to Running.

[IMG="im11"]https://miro.medium.com/max/1050/0*o9spaxr2JHKVm7LJ[/IMG]

Guide:

https://developer.huawei.com/consumer/en/doc/development/AppGallery-connect-Guides/agc-abtest-start-experiment

3.3 View The Experiment Report

You can view experiment reports in any state. For example, to view the report of a running experiment.

Process:

Go to the A/B Testing configuration page and find the experiment to be viewed in the experiment management list.

Click View report in the Operation column. The report page is displayed.

[IMG="im12"]https://miro.medium.com/max/1050/0*yDq_UTsRrUf-qpx6[/IMG]

Displayed Reports:

[IMG="13"]https://miro.medium.com/max/1050/0*158PpeUq3Cest8By[/IMG]

3.4 Increase The Percentage of Users Who Participate In The Experiment

You can view experiment reports in any state. For example, to view the report of a running experiment

Process:

1. Go to the A/B Testing configuration page and find the experiment whose scale needs to be expanded in the experiment management list.

2. Click Improve in the Operation column.

[IMG="14"]https://miro.medium.com/max/1050/0*NgOvgiTNDHeGp4KD[/IMG]

3. In the displayed dialog box, enter the target percentage and click OK.

[IMG="14"]https://miro.medium.com/max/753/0*d-JJTVPw5zXEL2Pr[/IMG]

3.5 Releasing an Experiment

You can release a running or finished remote configuration experiment.

3.5.1 Releasing a Remote Configuration Experiment

Process:

1. Go to the A/B Testing configuration page and find the experiment to be released in the experiment management list.

2. Click Release in the Operation column.

[IMG="im"]https://miro.medium.com/max/1050/0*zHUkxI3AFJhkaKuz[/IMG]

3. Select the treatment group to be released, set Condition name, and click Go to remote configuration.

You can customize the condition name meeting the requirements.

[IMG="im"]https://miro.medium.com/max/725/0*o9CZwmFHFuKBPLMr[/IMG]

4. The Remote Configuration page is displayed. Click Parameter Management and Condition management to confirm or modify the parameters and configuration conditions, and click Release.

3.5.2 Releasing a Notification Experiment

1. Go to the A/B Testing configuration page and find the experiment to be released in the experiment management list.

2. Click Release in the Operation column.

[IMG="im"]https://miro.medium.com/max/1050/0*ZOp57XIQlYTToCZn[/IMG]

3. Select the treatment group to be released and click Release message.

[IMG="i"]https://miro.medium.com/max/678/0*K1IKkDSkpYgrgxnS[/IMG]

3.6 Other Experiment Management Operations

3.6.1 Viewing an Experiment

You can view experiments in any state.

1. Go to the A/B Testing configuration page and find the experiment to be viewed in the experiment management list.

2. Click View details in the Operation column.

[IMG="i"]https://miro.medium.com/max/1050/0*wh1ShgmMT87P4i9n[/IMG]

3.6.2 Copying an Experiment

You can copy an experiment in any state to improve the experiment creation efficiency.

1. Go to the A/B Testing configuration page and find the experiment to be copied in the experiment management list.

2. Click Duplicate in the Operation column.

[IMG="i"]https://miro.medium.com/max/1050/0*5sWK85YnUK2cCg7F[/IMG]

3.6.3 Modifying an Experiment

You can modify experiments in draft state.

1. Go to the A/B Testing configuration page and find the experiment to be modified in the experiment management list.

2. Click Modify in the Operation column.

[IMG="l"]https://miro.medium.com/max/1050/0*fvSnUCNMWyM0BFE2[/IMG]

3. Modify the experiment information and click Save.

3.6.4 Stopping an Experiment

You can stop a running experiment.

1. Go to the A/B Testing configuration page and find the experiment to be stopped in the experiment management list.

2. Click Stop in the Operation column and click OK.

[IMG="k"]https://miro.medium.com/max/1050/0*5YaUUU3E_oWa0PMN[/IMG]

After the experiment is stopped, the experiment status changes to Finished.

[IMG="i"]https://miro.medium.com/max/1050/0*Ffkey-MRcxWLZsSV[/IMG]

3.6.4 Deleting an Experiment

You can delete an experiment in draft or finished state.

1. Go to the A/B Testing configuration page and find the experiment to be deleted in the experiment management list.

2. Click Delete in the Operation column and click OK.

[IMG="u"]https://miro.medium.com/max/1050/0*GuqDELOoCXTltas0[/IMG]

Resources

Enabling A/B Testing :

https://developer.huawei.com/consumer/en/doc/development/AppGallery-connect-Guides/agc-abtest-enable-ABtest

Creating a Remote Configuration Experiment

https://developer.huawei.com/consumer/en/doc/development/AppGallery-connect-Guides/agc-abtest-create-remoteconfig

Creating a Notification Experiment :

https://developer.huawei.com/consumer/en/doc/development/AppGallery-connect-Guides/agc-abtest-create-notification

Managing an Experiment :

https://developer.huawei.com/consumer/en/doc/development/AppGallery-connect-Guides/agc-abtest-manage-overview

Related Links

Thanks to Bayar Şahintekin for this article.

Original post: https://medium.com/huawei-developers/huawei-app-gallery-connect-a-b-testing-cc3147e9b967