Download a Blank TRT
Understanding the TRT Fields
Upload a TRT

Test Result Template (TRT)

Crystal Test allows for the use of two Excel spreadsheet templates; The Test Case Template (TCT) and the Test Result Template (TRT). This section will review the TRT. For information about the TCT, see Test Case Template (TCT). Crystal Test allows a user to to create test results by listing them and their properties on an Excel spreadsheet called a Test Result Template (TRT). You can then upload an entire list of test results for multiple test cases and projects on one sheet. As Crystal Test evolves, more fields may be added to the TRT and therefore it is recommended to always download a new blank TRT each time you create new test cases. Each time the TRT is updated, it is saved with a new datestamp in the filename to ensure you always have the latest file. Let’s create our first TRT.

Download a Blank TRT

To download a blank TRT, follow these steps:

1. Navigate to Admin --> Admin Test Cases
2. On the right column, in the Downloads section, click the link to the CT Test Result Template.
3. Save the template.

You can also download the TRT on the Documentation page of this Wiki.

Understanding the TRT Fields

Each field on the TRT corresponds to a field in the TestResults table in the Crystal Test database. Read the field descriptions below and create a TRT for one of your projects.

projectAbbreviation The projectAbbreviation and the testCaseId fields are used in conjunction with the testCaseId field to form a unique identity of a test case. For a list of project abbreviations, see the Admin Projects page of Crystal Test. If your project is not in the list, it will need to be added before you can upload test cases to it. See Projects for more information on project names and abbreviations. REQUIRED FIELD (CAN NOT BE BLANK)
testCaseId The numeric ID of the test case in which the test result relates. REQUIRED FIELD (CAN NOT BE BLANK)
environment Used to tell which application environment the test case was tested on. These options may be different depending on the project you are working on. Example: Dev, QA, Stage, Production REQUIRED FIELD (CAN NOT BE BLANK)
browserAbbreviation The browser field tells which browser that particular test was ran in. Currently the supported browserAbbreviations are Chrome, FF, IE8, IE9, IE10, IE11, MACSAF, WINSAF. REQUIRED FIELD (CAN NOT BE BLANK)
status The status field tells the result of the test. If a test can not be performed exactly as the test case states in its steps, then a test result should not be entered and the test case should be marked as test case outdated. The status options are currently: Pass, Fail, Not Started, In Progress (Used for Automation), In Queue (Used for Automation), Retest (Used for Automation)*, REQUIRED FIELD (CAN NOT BE BLANK)
reasonForStatus This field describes why the test failed, or any other information pertaining to the reason the particular status was chosen. The reasonForStatus field is shown on the test results page and therefore is expected to only be a short description of the problem. It is good practice to list expected and actual results here.
reasonForStatusDetailed The reasonForStatusDetailed field is primarily used by automation for longer descriptions such as stack traces etc. However, it can be also be used manually for longer descriptions.
stepsToReproduce This field is for telling the developers or other testers how to reproduce the bugs or issues found. Please list each step as you completed it including any data values entered into fields, users, etc. Please enter each step in a numbered list. To create a new line in a cell, press Alt-Enter.
defectTicketNumber Whenever a bug is reported from a failing test result, enter the defect tracking number in the corresponding test result. We use this field to track the number of issues found by each person/per browser, etc. In a future release, these defects will link to their defect management system
screenshots If you encounter a bug, try to get a screenshot so that the developers can see what you saw while testing. All URLs must end in .jpg, .gif, .bmp, or .png or it will not upload successfully. Seperate screenshot URLs with a pipe character ( | ) as a single test case can have several screenshots. Do not put spaces before or after the pipe character. If the screenshot is saved on your hard drive instead of the web, you can upload it on the test result details page in Crystal Test after the test result has been uploaded or created. Example:| Notice the pipe character between URLs.
screenshotDescriptions This is a list of descriptions that correspond to the screenshots listed in the previous field. For each screenshot listed, there should be a matching description. You can choose to not to add a description, however there needs to be the same amount of spaces, seperated by pipe characters as there are screenshots. Example: Screenshots field: loginscreen.jpg|usernamefield.bmp|passwordfield.png|okbutton.gif If you want to put a description for everything except the username field, you might enter the following in the description field: screenshotDescriptions: Login Screen||Password Field|OK Button Notice the pipe character between image files and the empty place where the username screenshot would be.

Upload a TRT

Now that you have created a TRT, we will need to upload it to Crystal Test. Crystal Test will let us know if we have made any mistakes and will not allow the TRT to upload until we fix them. It will tell us exactly what row in the spreadsheet the mistake is on and what the mistake is. Follow the steps below to upload a TRT.
  • Navigate to Admin --> Admin Test Cases
  • In the Upload Test Results panel, click the browse button and navigate to your test result file.
  • Click the Upload Test Results button

All Projects must be setup in Crystal Test before uploading test results to them. Providing there are no data conflicts, you will receive a message that states “File uploaded successfully.” The newly uploaded test results will be available for viewing on the Results tab of the Test Case Details page.

Last edited Apr 2, 2014 at 7:25 PM by jacquelinewalton, version 1