[Huawei Developers] John Wo:
Introduction

Testing has been around longer than we would think and by extension software testing isn’t a relatively new concept either. Before markets became more complicatedly connected and their customers became more diverse, businesses didn’t bother ensuring their products were of a high standard or fully fulfilled their purposes. Even government didn’t bother to enforce high quality standards in products which means many businesses use to cut corners.

If we look into our history, the most famous examples were the tests implemented by Alan Turing. In 1950 the Turing test originally called the imitation game by Alan Turing, is a test of a machine's ability to exhibit intelligent behaviour equivalent to, or indistinguishable from, that of a human. Turing also created tests used to check the validity of a large routine and ensuring it was correct.

Slow and steadily, government realised the potential immeasurable gains from opening up markets and trading globally, which therefore meant businesses needed to start putting out higher quality products to better compete with their foreign competitors.

Huawei Open Testing tool ensures the quality of the application before releasing to the market, sounds familiar right. The concept of open testing is to publish the app to a group of users for testing the application, gather feedback from them, make those changes according to the feedback received as email in the application and then release the application globally. This process helps to ensure the quality of the application in a timely manner.

Steps for Open Testing

Apply for Open Testing Service

Open testing is still in beta stage, so we need to write an email to agconnect@huawei.com in order to get the service enable for your project in developer console. The mail format is very simple, the title of the email should be in the following format:

[Open testing]-[Company name]-[Developer account ID]-[App ID]

Developer account ID and App ID can be found in agconnect-service.json file. cp_id indicates the Developer account ID and app id indicates the App ID as shown below:

[IMG="https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113072431.59262548397626327009722528361277:50511124024413:2800:7A06D8A697F3E250FC6A2A4433E24C155A1E87ED393CC8F7D93C42C4E152BDEE.png"]https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113072431.59262548397626327009722528361277:50511124024413:2800:7A06D8A697F3E250FC6A2A4433E24C155A1E87ED393CC8F7D93C42C4E152BDEE.png[/IMG]

Once Huawei Operations Personnel enable the service for our project, we can then avail the service provided by Huawei.

Creating Open Test User List

Before we jumped the gun, we need to create a list of users who will participate in the open testing. We can create up to 30 test user lists in total and 20 per day.

1) We need to Sign In to AppGallery Connect

2) Select User and permission

3) Navigate to User List and click New button

4) Provide a List Name, which acts as a group. Under List Name we can add multiple users.

5) Select Stored in as all, if we wish to invite testers globally otherwise we can choose country wise if the test users are from China, Russia, Germany or Singapore. By this way we can create different group or List Name for different country the users belong to.

6) User information can be manually added or by importing an excel sheet using File import mode. The template of excel is shown below:

[IMG="https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113072720.73833909657294708290021280405359:50511124024413:2800:A3E26690902E7CD4AFE7950369D42B2E0413BEEB3AE9EC3AE6BBB96CD09C377E.png"]https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113072720.73833909657294708290021280405359:50511124024413:2800:A3E26690902E7CD4AFE7950369D42B2E0413BEEB3AE9EC3AE6BBB96CD09C377E.png[/IMG]

7) Add User by providing their Huawei Id and name.

8) We can delete any invalid user from the list by simply selecting the dropdown functionality of Status as shown below:

[IMG="https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113072828.67011370251353688166290133309876:50511124024413:2800:7442962E7BEE1CF3287537240CF4A8C2531C9E1782F702FB04BA567789E505D7.png"]https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113072828.67011370251353688166290133309876:50511124024413:2800:7442962E7BEE1CF3287537240CF4A8C2531C9E1782F702FB04BA567789E505D7.png[/IMG]

9) The complete list will display as follows:

[IMG="https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113073124.77336263054006123010278656609688:50511124024413:2800:E99AB5698AA456415DBC1838F513B3E36629204C1C7ADE145F32B4CCC226BDAE.png"]https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113073124.77336263054006123010278656609688:50511124024413:2800:E99AB5698AA456415DBC1838F513B3E36629204C1C7ADE145F32B4CCC226BDAE.png[/IMG]

Releasing for Open Testing

After creating the list, we can release the app of the open testing version in AppGallery Connect and select the list of test users to distribute your app.

1) Select the app which we want to use for Open Testing

2) Select My App from the drop down

3) Select Distribute Tab

4) Navigate to Release App and select Draft

5) Navigate to open testing section and select yes in version for opening testing section.

6) Checked or select used for early access free of manual review. This mode allow us to add maximum 100 test users. If the option is not selected, manual review is required and we can invite up to 5000 test users.

7) Select a test period, the maximum validity period is 90 days. After the period is over the test users will not be able to find the app in the App Gallery.

8) Then select the list of users for testing. Remember we can select only 100 test users for open testing or 5000 test users if early access free for manual review is not selected.

9) Feedback email is needed as it will help app owner to get feedback from open test users and Invitation link validity period also need to be provided because a validity period of an email or SMS invitation link sent to a user, which starts from the time when the user receives the link and cannot exceed the number of days of the open test validity period. A link is valid when both this period and the open test period do not end.

[IMG="https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113073329.67126696854258119389653458944115:50511124024413:2800:89629CF0CE14B2AFD0D904AD4B33AB5A6F21283A47A98B8A00693498D8C55942.png"]https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113073329.67126696854258119389653458944115:50511124024413:2800:89629CF0CE14B2AFD0D904AD4B33AB5A6F21283A47A98B8A00693498D8C55942.png[/IMG]

Participate as Open Testing Users

Once the above process is done, an email will be send to the user who are participating as Open Testing Users. This email will contain a link to download the application from App Gallery after they sign in using their Huawei ID. The app will be shown as beta in the App Gallery as shown below:

[IMG="https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113073417.21404671923726533449688681491281:50511124024413:2800:C2C658CD2A908FE96BC5D5C17386982D84766DDAFC66D35ECBC628F1290CEA7F.png"]https://communityfile-dre.op.hicloud.com/FileServer/getFile/cmtybbs/001/647/156/2640091000001647156.20201113073417.21404671923726533449688681491281:50511124024413:2800:C2C658CD2A908FE96BC5D5C17386982D84766DDAFC66D35ECBC628F1290CEA7F.png[/IMG]

Tips & Tricks

Before we go ahead with Open Testing service, we should complete first the App Information section of Release app. Otherwise the app will not be release for Open Testing in App Gallery. We can also use some of the testing services provided by Huawei before releasing the app on App Gallery to maintain the quality. The testing services are as follows:

1) A/B Testing: When we have multiple UI design plans for the same scenario, we can create a remote configuration experiment in A/B Testing to deliver these variants to users for responsiveness. To know more check out the link below:

https://developer.huawei.com/consumer/en/doc/development/AppGallery-connect-Guides/agc-cloudtest-introduction

2) Cloud Testing: It helps us to automatically tests the compatibility, stability, performance, and power consumption of Android apps, without manual intervention. In Cloud Testing, we can test our app against the full range of Huawei phones, to determine if there are any potential issues, well in advance. To know more check out the link below:

https://developer.huawei.com/consumer/en/doc/development/AppGallery-connect-Guides/agc-abtest-introduction

Conclusion

We learn how to maintain the quality of an application by using Open Testing service provided by Huawei.

Feel free to comment, share and like the article. Also you can follow me to get awesome article like this every week.

For more reference

https://developer.huawei.com/consumer/en/doc/development/AppGallery-connect-Guides/agc-betatest-introduction