background
PM, RD and QA play important roles in the middle of software life, and their responsibilities are different in each stage. First, in the requirements phase, the PM needs to write a PRD and conduct requirements review. Secondly, after RD and QA participate in requirement review, RD will write design documents according to PRD and organize design review, QA will write test cases based on PRD and design documents, and QA will organize PM and RD to conduct test case review in the middle stage of RD development. Of course, sometimes THEY will also participate in code review of RD. Pay attention to technical implementation details and identify potential problems. Finally, in the test completion stage, QA will issue the test report of each round, and carry out the overall online regression verification after the launch.
In the whole software testing cycle, test cases and related documents are important basis for testing work, but the lack of documents and inconsistent management will greatly increase communication costs and reduce work efficiency.
Therefore, internal QA group start to build their own tools platform, which is to introduce the Chaoyue platform today, the goal is to make the visual effect, test measurement process, the current has supported use case management and report template platform functions, among them, the use case management platform has been widely used in various business, report template is in the stage of trial and optimize the platform, Subsequently, new functions will be added according to business requirements, and platform process management and collaboration tools will be built.
Introduction to Chaoyue platform
Chaoyue platform is based on the team’s demand to build a maoyan use-case management platform of its own. At present, it mainly realizes two functions, use-case management platform and template report platform, as shown in the following figure: Use-case management platform implements business group management, use-case group management, use-case management and use-case execution management. Template report platform to achieve demand management, before the release of email check management, self-test report, test report, test report management. At present, Chaoyue use case management platform has supported 70% of the company’s projects.
Chaoyue platform relies on cat-eye technology to improve efficiency, which aims to reduce learning costs and facilitate maintenance. React+ Antd Design development framework is used in the front end, which is convenient for QA to get started quickly. Baidu open source brain Map is introduced into the test case management platform for secondary development based on the open source brain map framework, which is convenient for quick construction and use. Meanwhile, email and internal communication tools are supported for message sending. The server is based on the Spring Boot development framework and manages data through Mysql database and S3 data storage service.
Chaoyue Use Case Management platform
Test case management comes in many forms. In the early offline test case management, it was more common to use Excel, as shown in the figure below
The advantages of this management mode are simple operation and detailed steps. Through the form of management, in the most simple way to test cases, local storage way also has the effect of stable and reliable, but the disadvantages of the local storage is also very obvious, when version rapid iteration, excel form of test case management efficiency is low, many people involved in the same demand, is also very difficult in operation and maintenance.
In the later period, with the rapid development of the Internet and the rapid iteration of business, the efficiency requirements for each link of the project process are becoming higher and higher. Many QA begin to use brain map to write and execute use cases for testing. The common Xmind tools are shown as follows:
This form of test cases on the operation is relatively simple, clear logical structure and writing use cases of high efficiency, at the same time, on the review of the test cases is very convenient, and could make the structure of the whole test process more clearly, but also, offline storage way also cannot support collaboration problems, in case the lack of consistency and execution statistics, Ultimately, use case maintenance costs are high.
There are a variety of online test case management methods, which are analyzed for relatively mature products used within the team, as follows:
By investigating the above offline and online test case management tools, we extracted the following three pain points
L Pain point 1: test case management and control is not unified, storage and management forms are different, including wiki and local Xmind, lack of unified management, unable to form document precipitation
L Pain point 2: Use cases can not be traced: if online problems are encountered, use cases and testing conditions can not be traced, and it will increase the difficulty of troubleshooting problems
L Pain point 3: Lack of statistics of data indicators during the execution of use cases, failure to measure the quality of use cases and improve the quality of testing, and failure to effectively assess the risk of missed testing
In order to solve the above pain points and provide the development that can support customization requirements, QA group started Chaoyue platform project internally. The goal is to build a visual test case management platform that supports collaboration, and at the same time get through the data of requirements and defects, effectively control the use case management through the platform, and realize the use case as the core. The process of pre-test – test execution – test results statistics – report after test is integrated management.
Combined with the life cycle of test cases and the work content of QA in each stage, the functions of the use case management platform are determined as follows:
1. In the requirement and development stage, QA will write and Review test cases. Chaoyue use case management platform supports multi-person online writing, online writing of use cases, offline writing of use case import, and online Review of use cases.
2. In the test execution stage, the use case management platform will conduct statistics and display of the test case execution results. In the later stage, the system of test cases and defects will be connected, the whole test activity will be measured, the test progress will be timely notified, and the test report will be generated
3. After the test, manage service groups and use cases to manage test cases
The following is the page display of Chaoyue use case Management platform
Business Management page – Example:
Use Case edit page – Example:
Chaoyue template reporting platform
Test without test report as the test result of measurement, analysis and evaluation of the project cycle, after the development of self-test need to release test report, test report and test phase to write test reports, statistical number of defects, and test quality report, and the processing of these reports only rely on artificial processing, inefficient. At the same time, in the continuous integration process, the key entrance of the test stage is missing, and the unified test specification is not clear.
So, QA internal platform developed template report, report is a key to achieve the target to send, the report support visualization, traceability, historical data platform integrates the ability of the test report, through automatic access to data, reduce the related report information editing and analysis of the human cost, at the same time, through continuous integration, realize the entrance automatic measurement.
The template reporting platform takes requirements as the starting point and manages reports at all stages through requirements. For example, a requirement includes self-test report, test report, test report and pre-release check, and supports email and notification functions to facilitate relevant personnel to receive messages in time, pay attention to the project progress, and establish a continuous delivery system from requirement generation to release production, so as to achieve the following objectives:
• Standardize and automate the flow of processes
• Improve the quality of node delivery in the delivery process
• Improve the execution efficiency of delivery processes
• Make the delivery process of requirements reliable, visible, and predictable.
The automatic function of testing process refers to that RD issues the application for testing, the system judges the access conditions, and QA confirms whether the testing is successful after passing the testing rules. The specific flow chart is as follows:
At present, the proposed test rules include the following three aspects:
1. Branch detection: automatic verification is carried out according to branch specifications to avoid test scenarios that do not conform to branch specifications
2. Static code check: Check the static code with Sonar rules and send the scan result back. If no serious problems occur, the check is successful
3. Statistics of self-test results: The self-test pass rate is automatically calculated according to the execution of test cases. When the pass rate is about 90%, the self-test is considered to have passed
Future Planning of Chaoyue — New Chaoyue
Chaoyue platform always is to realize the purpose of the whole process of continuous delivery, on the demand, development, testing, release, operational key nodes, play to the role of the platform, will deliver process combined with testing activities, will test design, test cases, test execution, defect management, test reports, and regression testing are integrated into the platform, Unified management through Chaoyue platform, support pipeline configuration, increase automatic execution, improve execution efficiency and save labor cost.
Vision: Provide “one-stop” solution for production and testing automation, build Chaoyue platform into a continuous integration platform driven by test process.
References:
www.tapd.cn/official/in…
www.testlink.org.cn/
www.atlassian.com/software/co…
www.zentao.net/