APP performance testing background

In any software testing process, performance testing is a very important link. What we generally call performance testing is divided into client side and server side. For client performance testing, especially for software like games and videos, such as constantly running out of time while playing games and extremely fast power consumption while watching videos, all directly affect user experience.

Requirements for performance testing mainly come from industry common standards, reference data of competing products, test data of historical versions, or direct customer feedback. App performance test indicators mainly include: response, memory, CPU, FPS, GPU rendering, power consumption, current consumption, etc.

The basic principle of APP performance test is to identify and find the code quality problems of APP and correct and optimize the program by monitoring various indicators of APP in different user operation scenarios.

APP performance test tool comparison

APP performance test index data can be obtained from ADB tools, integrated SDK tools and third-party tools. Mainstream third-party tools include Emmagee, ITest, GT, and PerfDog. Emmagee and itest currently only support Android system, while GT and PerfDog support both Android and iOS system. Both tools were developed by Tencent, while PerfDog was developed by Tencent’s game division, and its performance metrics are more stringent than typical app testing requirements. So, let’s focus on PerfDog.

PerfDog introduction

PerfDog website document: bbs.perfdog.qq.com/article-det…

PerfDog is installed and running

1. Download and install PerfDog

A, login PerfDog website perfdog.qq.com/, according to the bbs.perfdog.qq.com/article-det… Complete the account registration:

B. After registration, download the corresponding system version of your computer and install it

Windows: Unpack the download package and double-click perfdog.exe to open the desktop application.

Mac platform: Run DMG desktop applications directly.

C. Log in to the PC client using the registered user information after the installation

Once logged in, go to PerfDog’s home page:

2. Connect your phone to your computer

Connect the COMPUTER with a USB and PerfDog automatically detects the addition of the phone to the app list.

IOS: mobile phone trust computer, pop-up select trust.

Android: Provides non-installed mode and installed mode.

A. Non-installed mode: Enable the MOBILE phone USB debugging mode and select Enable debugging.

B. Installation mode: Enable the MOBILE phone USB debugging mode and allow USB installation. Make sure debugging is allowed when connecting.

In installation mode, PerfDog. Apk will be installed on the phone, and real-time performance data will be displayed on the screen of the phone (The Android phone must allow PerfDog suspension window management permission, otherwise performance data will not be displayed on the phone page).

If the following information is displayed, the mobile phone is connected successfully.

If PerfDog can’t detect the phone? Website provides a very detailed solution, for reference can be given solution: bbs.perfdog.qq.com/detail-128….

3. Select mobile test mode

There are two options for USB mode test and WIFI mode test.

If you need to test the power, only select WIFI mode test (because USB connection will charge). The WIFI mode test needs to ensure that the PC and mobile phone are under the same WIFI, and unplug the USB cable after the WIFI detection is successfully connected.

Note: In Android installation mode, when you select the mobile device for the first time, you will be prompted to install PerfDog. Apk. After installation, click “Allow PerfDog to run in the background” and open the suspension window management permission.

Another: If perfdog. Apk is not installed automatically on the phone, enter the installation folder of PerfDog PC client and find apK to install manually.

4. PerfDog client performance data collection

Panel 1: Select test application:

It displays all the apps installed on the phone and selects the specific app you want to test

Section 2: Device information and Settings

Device: Indicates the mobile Device information, including the operating system, CPU, GPU, screen size, and memory size

Setting: Sets frame rate FPS, frame generation time FrameTime, CPU, upstream and downstream traffic NetworkFlow

About: PerfDog version information, help description

Block 3: Chart data

Display the performance data captured in real-time in the form of graphs during the test (default FPS, CPU Usage, Memory Usage)

Block 4: Performance parameter Settings

Click the + button. Some common performance parameters are selected by default. You can select the performance parameters that you want to collect or display chart data

What are FPS, CPU Usage, Memory Usage, FrameTime, etc.? The corresponding performance index about the website bbs.PerfDog.qq.com/article-det…

Plate 5: Start recording/saving

A. The test begins

Click start recording to operate the application under test synchronously on the mobile phone, and the mobile phone suspension window displays performance data in real time

  • During the test, the performance data were calibrated and annotated:

Double-click the left mouse button to annotate. Left-click on the generated annotation to cancel it. Click the left mouse button to calibrate

  • Scenario Label: Double-click a color area to modify the Label name of the area and add multiple labels

B. The test is over

When the test is complete, click Save. Performance test data can be saved in two ways.

  • PerfDog Web Cloud: Upload data to the Web cloud by default
  • Local save: Select Save local, default Excel file records.

If you forget Start Recording, right-click the data you want to upload and save the data.

Module 6: Log Recording

5. Web cloud data analysis

Click the “Cloud icon” in the upper right corner of PerfDog client to enter the Cloud Web Kanban:

Performance Data detail page:

In addition to view the current cases to get the data, you can also add contrast, more Web console operation description: the clouds bbs.perfdog.qq.com/article-det…

6. Local data Excel file

Local test data playback:

Replay result:

conclusion

Ok, PerfDog is introduced and used here first. The main purpose of PerfDog is to help with data collection and management. In order to really do app performance test well, it is necessary to know performance test data analysis and problem location. But PerfDog has greatly simplified the task of collecting performance data. You don’t need to know how to collect multiple performance data or integrate multiple performance test results. It is also very simple to use and does not require ROOT/ jailbreak. It is the only mobile performance test tool in the whole network that supports iOS/Android/ applets /H5 and other mobile platforms. It also supports users to develop their own PerfDog performance tools or automated services based on service components.

PerfDog has been well received by mobile testers since its release. If you haven’t used PerfDog before, save your articles and try it while it’s free.