Test Cases

The definitions of the terms test case and test script are often ambiguous and are referred to differently depending on the person or testing tool. This handbook refers to a test case as the test of a single functionality with clearly defined steps and a single set of data and options. This handbook refers to a test script as a series of test cases executed in a specified order. When referring to a script developed using a programming language to automatically execute a test case, we call this an automated script.

Test cases are the heart of application testing. Crystal Test uses test ‘cases’ rather than test ‘scripts’ to assure clear and precise test coverage and other metrics as well as allowing tests cases and executions to be grouped easily. Crystal Test strives to offer a flexible and scalable system, therefore, if there are multiple parameterizations to a test, each is listed as a separate test case since it is effectively testing the functionality with different data, options, step differentials etc. This allows you to group some parameterizations as a smoke test while perhaps testing the remaining options in a regression test. This is also the backbone to the data-driven automation test architecture (D-DATA) used by Crystal Test to write and execute automated scripts)

When a test case is created, it is assigned a unique identification number that is coupled with its project abbreviation to form a test case ID. For example, the first Crystal Test test case will have a test case ID of CT-1.
If a test case is deleted, the test case ID will not be reused as test cases can be restored.

Warning: If you are using multiple Crystal Test environments (development/stage/production), test Case IDs on the development or stage/testing sites may change when the database is reset and may be different than Test Case IDs on the production site.

Often times, there are multiple ways to carry out tasks within Crystal Test. For example, you can choose to create all of your test cases manually in Crystal Test using the Add New Test Case form, or you can choose to list all test cases on an Excel Test Case Template (TCT) and upload them all at once. The following sections will cover all tasks that can be done with test cases.

Create a Test Case

This task refers to manually adding a test case to Crystal Test using the Add New Test Case form in Crystal Test. If you haven’t done so already, before creating a new test case, please review Best Practices for Writing Test Cases for Crystal Test.
Follow these steps to add a new test case:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Add New Test Case button in the Actions box on the right column. This will open the Add New Test Case form.
  • Select the project from the drop down box.
  • Fill in the Description field with the test case text and check the Active check box. These fields are required.

Add New Test Case

Note: To avoid possible future duplication, it is recommended to use the following test case template when writing test cases for Crystal Test: On the (put page name here) page, in the (put section name here) section (optional), verify that (put test info here).
  • Fill in the Steps field using a numbered list with one step per line. This is a required field.

Add Test Steps
  • Fill in the Expected Results field. This is the expected state of the application after all steps have been executed. This is a required field.
  • You may fill in the Notes fields but it is not a required field.
  • Choose your method for adding a screenshot. You can either upload an image from your computer or enter a URL to an image that is hosted on the web.
    • To upload a screenshot from your hard drive, click the Browse button in the Upload Screenshot section. Select the image you wish to upload. Fill in the description field and click the Upload Screenshot button. This step can be completed multiple times to upload multiple screenshots.
    • To enter a URL for a screenshot, enter the URL in the Image URL field. Fill in the description field and click the Upload Screenshot button. This step can be completed multiple times to upload multiple screenshots.

Add New Screenshot

Warning: If you work in healthcare, banking, insurance or other business that pertains to Personal Health Information(PHI) or Personal Financial Information(PFI), never upload images externally (even to your screencast account) if it contains PHI or PFI! Take care to black out any PHI or PFI if uploading such images to Crystal Test.
If you upload a screenshot and then decide you do not want to attach it to the test case, you can delete the screenshot from the deletion box before saving the test case. After the test case is added, you can delete the screenshot from the Test Case Details page.

Delete Screenshot
  • Select the Groups, Sprints, and Releases that the test case belongs to. If a Group/Sprint/Release does not exist, you can create it from this form by clicking the icon next to the Group/Sprint/Release header.

Add Groups/Sprints/Releases
  • Click the Add button at the bottom of the form.

Edit a Test Case

Follow the instructions to below to edit a test case:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to edit.
  • Click the Edit button in the top right corner

Edit Test Case
  • Edit the desired fields
  • Click the Update button at the bottom of the form

Add a Screenshot to an Existing Test Case

Follow the instructions below to add a screenshot to an existing test case:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to edit.
  • Click the Add Screenshot icon.
  • Choose your method for adding a screenshot. You can either upload an image from your computer or enter a URL to an image that is hosted on the web.
    • To upload a screenshot from your hard drive, click the Browse button in the Upload Screenshot section. Select the image you wish to upload. Fill in the description field and click the Upload Screenshot button. This step can be completed multiple times to upload multiple screenshots.
    • To enter a URL for a screenshot, enter the URL in the Image URL field. Fill in the description field and click the Upload Screenshot button. This step can be completed multiple times to upload multiple screenshots.

Add New Screenshot

Remove a Screenshot from an Existing Test Case

Follow these instructions to remove a screenshot:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to edit.
  • Under the screenshot section, click the Delete icon next to the image.

Add a Test Case to a Group

Follow these instructions to add a test case to an existing group:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to edit.
  • On the left column, in the Groups section, select the desired group in the Groups dropdown
  • Click the Add button

Add to Group

Adding Multiple Test Cases to a Group

Follow these instructions to add multiple test cases to an existing group:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Select the checkbox of multiple test cases.
  • Click the Add to Group icon in the Icon Menu. A dropdown box will appear with a list of groups.
  • Select the group you wish to add the test cases to.
  • Click OK on the confirmation box.

Remove a Test Case from a Group

Follow these instructions to remove a test case from an existing group:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to edit.
  • On the left column, in the Groups section, click the Delete button next to the desired group in the Groups dropdown.

Remove from Group

Add a Test Case to a Sprint

Follow these instructions to add a test case to an existing sprint:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to edit.
  • On the left column, in the Sprints section, select the desired sprint in the Sprints dropdown
  • Click the Add button

Add Multiple Test Cases to a Sprint

Follow these instructions to add multiple test cases to an existing sprint:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Select the checkbox of multiple test cases.
  • Click the Add to Sprint icon in the Icon Menu. A dropdown box will appear with a list of sprints.
  • Select the sprint you wish to add the test cases to.
  • Click OK on the confirmation box.

Remove a Test Case from a Sprint

Follow these instructions to remove a test case from an existing group:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to edit.
  • On the left column, in the Sprints section, click the Delete button next to the desired sprint in the Groups dropdown

Add a Test Case to a Release

Follow these instructions to add a test case to an existing release:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to edit.
  • On the left column, in the Releases section, select the desired release in the Releases dropdown
  • Click the Add button

Adding Multiple Test Cases to a Release

Follow these instructions to add multiple test cases to an existing release:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Select the checkbox of multiple test cases.
  • Click the Add to Release icon in the Icon Menu. A dropdown box will appear with a list of releases.
  • Select the release you wish to add the test cases to.
  • Click OK on the confirmation box.

Remove a Test Case from a Release

Follow these instructions to remove a test case from an existing group:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to edit.
  • On the left column, in the Releases section, click the Delete button next to the desired release in the Groups dropdown

Test Case History

Every time a test case is updated, a record is stored of its change. Crystal Test does not store a record each time the test case is added or removed from a group/sprint/release or when screenshots are added or removed. It only stores a change record the actual description, steps, expected result, or notes section is updated.

Follow the steps below to view the update history of a test case:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button for the test case in which you wish to edit.
  • Click the History tab.

Test Case History

Deleting a Test Case

Deleting a test case will also delete all test results associated with it and remove it from the groups, sprints and releases it currently belongs to. Deleted test cases and their results as well its releases, sprints, and group associations can be restored via the admin page. This is a security measure to ensure no loss of data.
To delete a test case:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Click the Details button next to the test case you wish to update
  • Click the Delete Test Case button

Delete Test Case
  • Click OK on the Delete Test Case confirmation

Deleting Multiple Test Cases

Follow these instructions to delete multiple test cases:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Select the checkbox of multiple test cases.
  • Click the Delete icon in the Icon Menu.
  • Click OK on the confirmation box.

Bulk Delete

Restoring a Test Case

To restore a deleted test case:
  • Navigate to Admin --> Admin Test Cases
  • In the Deleted Test Cases section, verify the correct project is selected in the Project dropdown.
  • Click the Restore button next to the test case you wish to restore.
  • Click OK on the confirmation box.

Restore Test Case

Assigning Test Cases to Users

In Quality Assurance, we often assign the responsibility of testing a test cases to ourselves or others. We then create some sort of list to keep track of which test cases belong to us. Crystal Test allows you to assign test cases to yourself or others. The assigned test cases will then appear in the user’s Personal Task List in their profile, sorted by date assigned.
To assign a test case:
  • Click the Testing button on the menu bar. This will open the Test Case List page.
  • Select the checkbox of the test cases you wish to assign.
  • Click the Assign Test Case icon in the Icon Menu. A dropdown will appear with all registered users.
  • Select the desired user.
  • Click OK on the confirmation box.

Assign Test Case

Last edited Apr 2, 2014 at 5:07 PM by jacquelinewalton, version 14