Add a Test Result from the Test Case List
Add a Test Result from the Details Page
Mass Pass
Viewing Test Results
Editing Results
Adding Screenshots to a Results
Remove a Screenshot from a Test Result

Test Results

Test results provide us with important information about the status and risk level of our application. A tester or manager will use test results to decide if an application is ready for a release. Crystal Test keeps a record of all test results. Reviewing this history can give us insight to repetitive defects and risk areas of our application. The Test Case List page displays the latest test result for each supported browser. Just as there are multiple ways to create a test case in Crystal Test, the same holds true for test results. For example, you can choose to add all of your test results manually in Crystal Test using the Add New Test Result form, or you can choose to list all test results on an Excel Test Result Template (TRT) and upload them all at once.

Add a Test Result from the Test Case List

If you have done so already, before creating a new test result, please review Understanding the TRT Fields. Follow these steps to record a test result from the Test Case List page:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Verify that All or Manual is selected in the View dropdown on the left column.
  • Click the Test button next to the test case you wish to test. This will open the Insert Test Result page
  • Fill in the result fields and click Insert button.

Add Results

Add a Test Result from the Details Page

This task refers to manually adding a test result to Crystal Test using the Insert Test Result form in Crystal Test. If you have done so already, before creating a new test result, please review Test Result Template (TRT).
Follow these steps to add a new test result:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to review results.
  • Click the Add icon in the Details Icon Menu. This will open the Insert Test Results page.
  • Fill in the result fields and click Insert button.

Mass Pass

Often times, as a tester acquires more experience and testing has become repetitive, testers will tend to run several tests before stopping to record a status as long as tests are passing. For this reason, Crystal Test has a Mass Pass feature to allow the tester to record a passing result for several test cases and for all browsers with just a few clicks.
To enter a Mass Pass result:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Select the checkbox of the test cases you wish to pass.
  • Click the Mass Pass icon in the Icon Menu.

Mass Pass

Note: The Mass Pass button will enter a passing test result for all selected test cases for all project-supported browsers. The ability to select specific browsers is planned for a future release.

Viewing Test Results

To view test results for a test case:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to review results.
  • Select the Results tab.
  • To view earlier results, click through the pagination to locate the results desired.

Results Tab
  • Test results can be filtered by environment and/or browser by selecting the desired options in the filter dropdowns on the left column.

Editing Results

In the event that you need to change or edit a test result:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to review results.
  • Select the Results tab.
  • Click the Details button next to the desired result.
  • Click the Edit button on the Test Result Details page.

Adding Screenshots to a Results

Screenshots are an important component of a test result. It allows us to get a clear picture of the issue. Whenever a test fails, it is a good idea to always add a screenshot of any error messages or visible results that differ from expected results.
To add a screenshot to a result:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to review results.
  • Select the Results tab.
  • Click the Details button next to the desired result.
  • On the right column, click the Add Screenshot button.
  • Choose your method for adding a screenshot. You can either upload an image from your computer or enter a URL to an image that is hosted on the web.
    • To upload a screenshot from your hard drive, click the Browse button in the Upload Screenshot section. Select the image you wish to upload. Fill in the description field and click the Upload Screenshot button. This step can be completed multiple times to upload multiple screenshots.
    • To enter a URL for a screenshot, enter the URL in the Image URL field. Fill in the description field and click the Upload Screenshot button. This step can be completed multiple times to upload multiple screenshots.

Add Screenshot

Warning: If you work in healthcare, banking, insurance or other business that pertains to Personal Health Information(PHI) or Personal Financial Information(PFI), never upload images externally (even to your screencast account) if it contains PHI or PFI! Take care to black out any PHI or PFI if uploading such images to Crystal Test.

After the screenshot is added, you can delete the screenshot from the Test Results Details page.

Remove a Screenshot from a Test Result

Follow these instructions to remove a screenshot:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to review results.
  • Select the Results tab.
  • Click the Details button next to the desired result.
  • Under the screenshot section, click the Delete icon next to the image.

Last edited Apr 2, 2014 at 6:28 PM by jacquelinewalton, version 3