QA Table of Contents

Skip to end of metadata
Go to start of metadata

The purpose of this page is to serve as a repository for all information about the Quality Assurance department.  This includes processes, Best Practices and links to commonly used resources.

The Quality Team's primary goals are:

  • Evaluate Pentaho Software and be able to provide the following statistics (Product Owners will use these statistics to determine if the RC software is valid for release):
    • Known unresolved defects
    • Test coverage percentage for areas covered by test cases (i.e. 50% of dashboards functionality is covered by test cases)
    • Test coverage percentage for configurations covered by test cases and test plans (i.e. 80% of the supported configurations have been fully tested, 10% have been partially tested, 10% have not been tested)
    • Test execution percentage and status for the test plan execution (i.e. 80% of the test plan has been executed - the outstanding areas are ...)
    • Known risks / gaps that will cause measurement inaccuracies
  • Evaluate Pentaho software during development to identify new defects / regressions based on current development
    • Tracking new development and identify impact to existing test cases
    • Perform periodic regression measurements to quickly identify newly created defects during development
  • Tracking incoming defect reports and identify potential updates to test cases / future test plans
    • Determine if the defects should have been captured with previous testing effort and identify gaps if so
    • Determine what update to the test cases / test plan should be made (if any)

Testing Tools

Name Description Wiki page Link
JIRA Tool for managing Bugs, Improvements and New Features http://jira.pentaho.com/secure/Dashboard.jspa
Spiratest Tool for managing Test Cases http://spiratest.pentaho.com
Test Rails TestRail is a web-based test case management software to manage,
track and organize software testing efforts
http://testrail.pentaho.com
     
     

Process Docs

Name Description Wiki page Link
JIRA JIRA Best Practices

Spiratest Spiratest Best Practices

Testrail User Guide How to use TestRails to Add, Edit test cases to projects http://wiki.pentaho.com/display/PEOpen/Test+Rails+User+guide
     
     
Enter labels to add to this page:
Please wait 
Looking for a label? Just start typing.