AQuality tracking is a Test Tracking system developed for engineers who are using test automation.

The system allows to do the following:

  1. Do a review of Test Run results
  2. Store statistics and history
  3. Compare Test Runs results
  4. Track Result for each test separately

URL

http://se-community-a1qa.lyrtech.org:8080/

Repository

https://github.com/aquality-automation/aquality-tracking

Wiki

https://github.com/aquality-automation/aquality-tracking/wiki

Main features

a. Upload test result automatically

The AQuality tracking has its own API. And there is a possibility to execute the curl command which will send the results of the test execution to AQuality tracking. 

It looks like the following:

curl -X POST "http://localhost:8888/api/import
?projectId=@id
&testNameKey=descriptionNode
&format=@format
&suite=@suitename
&buildName=@buildName
&author=@author
-H "accept:application/json"
-H "Content-Type: multipart/form-data" -F "uploadFile=@filepath"

To execute the curl we have to have a file with results of whole test execution(xml file for testng). 

To have a results in a real time we have implemented an additional dependency for our framework which allows us to send the result of each test immediately. The source code is https://github.com/aquality-automation/aquality-tracking-integrations-java. We just have to specify the needed parameters in mvn cleen test command. The command looks like the following:

mvn clean test -Daquality.enabled={true/false} 
-Daquality.host={aquality_tracking_address} //http://se-community-a1qa.lyrtech.org:8080/api
-Daquality.token={api_token} //to get the token go to Settings-> API token-> Select project-> Generate token
-Daquality.projectId={project_id} //the id is in the URL. For example http://se-community-a1qa.lyrtech.org:8080/#/project/1 id is 1
-Daquality.executor={name_of_executor} //anything you want
-Daquality.suiteName={test_suite_name} //anything you want
-Daquality.buildName={build_name} //anything you want
-Daquality.environment={execution_env} //anything you want
-Daquality.ciBuild={link_to_ci_build} //anything you want
-Daquality.debug={true/false}
-Daquality.attachmentsDirectory={path_to_directory_with_attachments} // for example target/attachments


b. Issues and Resolutions

The AQuality tracking is a tool which allows automation engineers to analyze the test execution results and store them. The results automatically uploads to the tool and when the execution is finished we have to figure out is any new bugs or any other issues there. 

Here is an example:

There is one test cases which were failed.

Let's imagine it's a bug and we are not able to use any library cards. 

The AQuality tracking allows us to create an issue and assign the issue to the failed test case. An in case of the test case already marked by any specific issue will be failed because of the same reason it will be automatically marked by the issue(created previously). That logic saves a time for an automation engineer to do analyzes of an test execution result.

To create an issue go to Issue → Create issue → Set the required fields

When the issue has created you can assign it to the exact failed test case. 


c. Attachments

The AQuality tracking has an ability to attach a file for each failed test case. We do attached a log file of the autotest and a screenshot if a test case fails. 

d. Test case history

The AQuality tracking stores test case execution history. You just have to open the test case page.

Process

  • No labels