Ins & Outs of Software Testing Technology Under One Roof
MENUMENU
  • Home
  • Certifications Resources
    • HP QTP Certifications
    • PMI PMP Certification Preparation
    • PMI PMP Certification Exam Practice Question Papers
    • CSTE Certifications
    • IBM RFT Certification
    • ISTQB Certifications
    • ISTQB Advanced CTAL Test Manager Exam-Crash Course
    • ISTQB Advanced CTAL Test Analysts Exam-Crash Course
    • ISTQB Foundation Level Exam Crash Course
    • ISTQB Foundation Exam - Sample Question Papers
    • ISTQB Agile Tester Extension Exam
    • ISTQB Advanced Test Managers Exam Preparation
    • ISTQB Advanced CTAL Exam Preparation
  • Knowledge Center
    • Career Building in Testing
      • Qualities of Test Personnel
      • Career Shaping in QA
    • Interview Preparation - FAQ
      • FAQ - Rehearsal of QTP in 1 Hr.
      • FAQ - Rehearsal of LoadRunner in 1 Hr.
      • FAQ - Common HR Questions
      • FAQ - Tricky HR Questions
      • FAQ - Software Testing and QA
      • FAQ - QTP - Quick Test Professional
      • FAQ - HP Load Runner (Controller)
      • FAQ - HP Load Runner (VuGen)
      • FAQ - HP Load Runner (Basics)
      • FAQ - RFT - Rational Functional Tester
      • FAQ - Database Testing
      • FAQ - Silk Test
    • Flamboyant Topics
      • Software Bugs
      • White Box Testing
      • Gray Box Testing
      • Black Box Testing
      • Website Testing
      • Database Testing
      • SDLC & STLC
      • Risk Analysis
      • Test Cases
      • Software Development Models
      • Achievements
    • QA Best Practices
      • Software Testing - General
    • New Technologies
      • Robotic Process Automation
      • Big Data
    • Glossary Encyclopedia
      • Encyclopedia - Software Testing Terms
      • Glossary Encyclopedia - Linked articles
    • Favorite Industry Topics
      • Global Recession
  • Automation Testing
    • Automation Testing
      • Review your RFT Skills
      • Review your LoadRunner HPO-M49 Skills
      • Review your LoadRunner HPO-M48 Skills
      • Review your Performance Center HPO-M47 Skills
      • Review Your HP QTP / UFT Skills
      • Review Your Quality Center Skills
      • Automation Frameworks
      • Ins & Outs of Automation
    • Hot Automation Tools
      • Selenium WebDriver
      • Selenium IDE
      • Katalon Studio
      • IBM Rational Functional Tester
      • HP LoadRunner
      • HP WinRunner
      • HP Quality Center
      • HP Quick Test Professional / UFT
      • Functional Testing Tools - Linked Articles
  • Manual Testing
    • Manual Testing
      • Various Approaches
      • Test Planning
    • Software Testing Startup Kit
      • Startup Articles
      • Basics of Testing
      • Quality Perspective
      • Types of Testing
      • Testing Tools
      • Types of Software Testing - Linked Articles
    • Quality Systems
      • QA Managers Skill Test
      • Software Testing Skill Test
      • Quality Management
      • CMM & CMMI
      • Verification & Validation (V&V)
      • Quality Perspective - Linked Articles
    • Templates & Checklists
      • Templates for Download
      • Checklists for Testers & Developers
      • Checklists for QA Managers & Team Leads
  • Tutorials
    • Tutorials: HP QTP / UFT
    • Tutorials: HP LoadRunner
    • Tutorials: IBM Rational Functional Tester
  • Quizes
    • HP QC Expert Level Quiz
    • QTP Basic Level Quiz
    • QTP Intermediate Level Quiz
    • QTP Expert Level Quiz
    • RFT - Rational Functional Tester Quiz
    • Software Testing Basics Quiz
    • ISTQB Certification Quiz
    • CSTE Certification Quiz
  • Free eBooks
    • eBooks: HP QTP/UFT
    • eBooks: Manual Testing
MENUMENU
  • Home
  • Certifications Resources
    • HP QTP Certifications
    • PMI PMP Certification Preparation
    • PMI PMP Certification Exam Practice Question Papers
    • CSTE Certifications
    • IBM RFT Certification
    • ISTQB Certifications
    • ISTQB Advanced CTAL Test Manager Exam-Crash Course
    • ISTQB Advanced CTAL Test Analysts Exam-Crash Course
    • ISTQB Foundation Level Exam Crash Course
    • ISTQB Foundation Exam - Sample Question Papers
    • ISTQB Agile Tester Extension Exam
    • ISTQB Advanced Test Managers Exam Preparation
    • ISTQB Advanced CTAL Exam Preparation
  • Knowledge Center
    • Career Building in Testing
      • Qualities of Test Personnel
      • Career Shaping in QA
    • Interview Preparation - FAQ
      • FAQ - Rehearsal of QTP in 1 Hr.
      • FAQ - Rehearsal of LoadRunner in 1 Hr.
      • FAQ - Common HR Questions
      • FAQ - Tricky HR Questions
      • FAQ - Software Testing and QA
      • FAQ - QTP - Quick Test Professional
      • FAQ - HP Load Runner (Controller)
      • FAQ - HP Load Runner (VuGen)
      • FAQ - HP Load Runner (Basics)
      • FAQ - RFT - Rational Functional Tester
      • FAQ - Database Testing
      • FAQ - Silk Test
    • Flamboyant Topics
      • Software Bugs
      • White Box Testing
      • Gray Box Testing
      • Black Box Testing
      • Website Testing
      • Database Testing
      • SDLC & STLC
      • Risk Analysis
      • Test Cases
      • Software Development Models
      • Achievements
    • QA Best Practices
      • Software Testing - General
    • New Technologies
      • Robotic Process Automation
      • Big Data
    • Glossary Encyclopedia
      • Encyclopedia - Software Testing Terms
      • Glossary Encyclopedia - Linked articles
    • Favorite Industry Topics
      • Global Recession
  • Automation Testing
    • Automation Testing
      • Review your RFT Skills
      • Review your LoadRunner HPO-M49 Skills
      • Review your LoadRunner HPO-M48 Skills
      • Review your Performance Center HPO-M47 Skills
      • Review Your HP QTP / UFT Skills
      • Review Your Quality Center Skills
      • Automation Frameworks
      • Ins & Outs of Automation
    • Hot Automation Tools
      • Selenium WebDriver
      • Selenium IDE
      • Katalon Studio
      • IBM Rational Functional Tester
      • HP LoadRunner
      • HP WinRunner
      • HP Quality Center
      • HP Quick Test Professional / UFT
      • Functional Testing Tools - Linked Articles
  • Manual Testing
    • Manual Testing
      • Various Approaches
      • Test Planning
    • Software Testing Startup Kit
      • Startup Articles
      • Basics of Testing
      • Quality Perspective
      • Types of Testing
      • Testing Tools
      • Types of Software Testing - Linked Articles
    • Quality Systems
      • QA Managers Skill Test
      • Software Testing Skill Test
      • Quality Management
      • CMM & CMMI
      • Verification & Validation (V&V)
      • Quality Perspective - Linked Articles
    • Templates & Checklists
      • Templates for Download
      • Checklists for Testers & Developers
      • Checklists for QA Managers & Team Leads
  • Tutorials
    • Tutorials: HP QTP / UFT
    • Tutorials: HP LoadRunner
    • Tutorials: IBM Rational Functional Tester
  • Quizes
    • HP QC Expert Level Quiz
    • QTP Basic Level Quiz
    • QTP Intermediate Level Quiz
    • QTP Expert Level Quiz
    • RFT - Rational Functional Tester Quiz
    • Software Testing Basics Quiz
    • ISTQB Certification Quiz
    • CSTE Certification Quiz
  • Free eBooks
    • eBooks: HP QTP/UFT
    • eBooks: Manual Testing
Ins & Outs of Software Testing Technology Under One Roof
MENUMENU
  • Home
  • Certifications Resources
    • HP QTP Certifications
    • PMI PMP Certification Preparation
    • PMI PMP Certification Exam Practice Question Papers
    • CSTE Certifications
    • IBM RFT Certification
    • ISTQB Certifications
    • ISTQB Advanced CTAL Test Manager Exam-Crash Course
    • ISTQB Advanced CTAL Test Analysts Exam-Crash Course
    • ISTQB Foundation Level Exam Crash Course
    • ISTQB Foundation Exam - Sample Question Papers
    • ISTQB Agile Tester Extension Exam
    • ISTQB Advanced Test Managers Exam Preparation
    • ISTQB Advanced CTAL Exam Preparation
  • Knowledge Center
    • Career Building in Testing
      • Qualities of Test Personnel
      • Career Shaping in QA
    • Interview Preparation - FAQ
      • FAQ - Rehearsal of QTP in 1 Hr.
      • FAQ - Rehearsal of LoadRunner in 1 Hr.
      • FAQ - Common HR Questions
      • FAQ - Tricky HR Questions
      • FAQ - Software Testing and QA
      • FAQ - QTP - Quick Test Professional
      • FAQ - HP Load Runner (Controller)
      • FAQ - HP Load Runner (VuGen)
      • FAQ - HP Load Runner (Basics)
      • FAQ - RFT - Rational Functional Tester
      • FAQ - Database Testing
      • FAQ - Silk Test
    • Flamboyant Topics
      • Software Bugs
      • White Box Testing
      • Gray Box Testing
      • Black Box Testing
      • Website Testing
      • Database Testing
      • SDLC & STLC
      • Risk Analysis
      • Test Cases
      • Software Development Models
      • Achievements
    • QA Best Practices
      • Software Testing - General
    • New Technologies
      • Robotic Process Automation
      • Big Data
    • Glossary Encyclopedia
      • Encyclopedia - Software Testing Terms
      • Glossary Encyclopedia - Linked articles
    • Favorite Industry Topics
      • Global Recession
  • Automation Testing
    • Automation Testing
      • Review your RFT Skills
      • Review your LoadRunner HPO-M49 Skills
      • Review your LoadRunner HPO-M48 Skills
      • Review your Performance Center HPO-M47 Skills
      • Review Your HP QTP / UFT Skills
      • Review Your Quality Center Skills
      • Automation Frameworks
      • Ins & Outs of Automation
    • Hot Automation Tools
      • Selenium WebDriver
      • Selenium IDE
      • Katalon Studio
      • IBM Rational Functional Tester
      • HP LoadRunner
      • HP WinRunner
      • HP Quality Center
      • HP Quick Test Professional / UFT
      • Functional Testing Tools - Linked Articles
  • Manual Testing
    • Manual Testing
      • Various Approaches
      • Test Planning
    • Software Testing Startup Kit
      • Startup Articles
      • Basics of Testing
      • Quality Perspective
      • Types of Testing
      • Testing Tools
      • Types of Software Testing - Linked Articles
    • Quality Systems
      • QA Managers Skill Test
      • Software Testing Skill Test
      • Quality Management
      • CMM & CMMI
      • Verification & Validation (V&V)
      • Quality Perspective - Linked Articles
    • Templates & Checklists
      • Templates for Download
      • Checklists for Testers & Developers
      • Checklists for QA Managers & Team Leads
  • Tutorials
    • Tutorials: HP QTP / UFT
    • Tutorials: HP LoadRunner
    • Tutorials: IBM Rational Functional Tester
  • Quizes
    • HP QC Expert Level Quiz
    • QTP Basic Level Quiz
    • QTP Intermediate Level Quiz
    • QTP Expert Level Quiz
    • RFT - Rational Functional Tester Quiz
    • Software Testing Basics Quiz
    • ISTQB Certification Quiz
    • CSTE Certification Quiz
  • Free eBooks
    • eBooks: HP QTP/UFT
    • eBooks: Manual Testing
MENUMENU
  • Home
  • Certifications Resources
    • HP QTP Certifications
    • PMI PMP Certification Preparation
    • PMI PMP Certification Exam Practice Question Papers
    • CSTE Certifications
    • IBM RFT Certification
    • ISTQB Certifications
    • ISTQB Advanced CTAL Test Manager Exam-Crash Course
    • ISTQB Advanced CTAL Test Analysts Exam-Crash Course
    • ISTQB Foundation Level Exam Crash Course
    • ISTQB Foundation Exam - Sample Question Papers
    • ISTQB Agile Tester Extension Exam
    • ISTQB Advanced Test Managers Exam Preparation
    • ISTQB Advanced CTAL Exam Preparation
  • Knowledge Center
    • Career Building in Testing
      • Qualities of Test Personnel
      • Career Shaping in QA
    • Interview Preparation - FAQ
      • FAQ - Rehearsal of QTP in 1 Hr.
      • FAQ - Rehearsal of LoadRunner in 1 Hr.
      • FAQ - Common HR Questions
      • FAQ - Tricky HR Questions
      • FAQ - Software Testing and QA
      • FAQ - QTP - Quick Test Professional
      • FAQ - HP Load Runner (Controller)
      • FAQ - HP Load Runner (VuGen)
      • FAQ - HP Load Runner (Basics)
      • FAQ - RFT - Rational Functional Tester
      • FAQ - Database Testing
      • FAQ - Silk Test
    • Flamboyant Topics
      • Software Bugs
      • White Box Testing
      • Gray Box Testing
      • Black Box Testing
      • Website Testing
      • Database Testing
      • SDLC & STLC
      • Risk Analysis
      • Test Cases
      • Software Development Models
      • Achievements
    • QA Best Practices
      • Software Testing - General
    • New Technologies
      • Robotic Process Automation
      • Big Data
    • Glossary Encyclopedia
      • Encyclopedia - Software Testing Terms
      • Glossary Encyclopedia - Linked articles
    • Favorite Industry Topics
      • Global Recession
  • Automation Testing
    • Automation Testing
      • Review your RFT Skills
      • Review your LoadRunner HPO-M49 Skills
      • Review your LoadRunner HPO-M48 Skills
      • Review your Performance Center HPO-M47 Skills
      • Review Your HP QTP / UFT Skills
      • Review Your Quality Center Skills
      • Automation Frameworks
      • Ins & Outs of Automation
    • Hot Automation Tools
      • Selenium WebDriver
      • Selenium IDE
      • Katalon Studio
      • IBM Rational Functional Tester
      • HP LoadRunner
      • HP WinRunner
      • HP Quality Center
      • HP Quick Test Professional / UFT
      • Functional Testing Tools - Linked Articles
  • Manual Testing
    • Manual Testing
      • Various Approaches
      • Test Planning
    • Software Testing Startup Kit
      • Startup Articles
      • Basics of Testing
      • Quality Perspective
      • Types of Testing
      • Testing Tools
      • Types of Software Testing - Linked Articles
    • Quality Systems
      • QA Managers Skill Test
      • Software Testing Skill Test
      • Quality Management
      • CMM & CMMI
      • Verification & Validation (V&V)
      • Quality Perspective - Linked Articles
    • Templates & Checklists
      • Templates for Download
      • Checklists for Testers & Developers
      • Checklists for QA Managers & Team Leads
  • Tutorials
    • Tutorials: HP QTP / UFT
    • Tutorials: HP LoadRunner
    • Tutorials: IBM Rational Functional Tester
  • Quizes
    • HP QC Expert Level Quiz
    • QTP Basic Level Quiz
    • QTP Intermediate Level Quiz
    • QTP Expert Level Quiz
    • RFT - Rational Functional Tester Quiz
    • Software Testing Basics Quiz
    • ISTQB Certification Quiz
    • CSTE Certification Quiz
  • Free eBooks
    • eBooks: HP QTP/UFT
    • eBooks: Manual Testing
Home > Blog > Automation Testing > Automation Testing > Automation Frameworks > Measurement of Quality of the Testing and Test Automation Process

Measurement of Quality of the Testing and Test Automation Process

Sign up to receive Regular updates via email or RSS!

Type your email address and press Enter

Download Free eBooks

Download Several World-Class eBooks on "Software Testing" and "Quality Assurance" Absolutely Free of Cost!!!


Quick Links

  • Free Updates
  • Write & Earn
  • Quick Navigation Sitemap
  • ISTQB Certification
  • QTP Certifications

Advertisements

Measurement of Quality of the Testing and Test Automation Process

Posted in: Automation Frameworks
Leave a comment

Measurement of Quality of the Testing and Test Automation Process

Although test measurement profiles differ from organization to organization; yet software testing experts emphasize that the quality of testing and test automation process must be measured in some way or the other. They declare that anything can be made measurable in a way that is better than not measuring it at all.

Through measurement only it is possible to monitor and control the testing process. As a result software testing managers are able to optimize it to suit the situation suiting the organization. It is important that measurements are realistic: measure what is achievable, addresses the organizational objectives & most important aspect is that it must be useful. For a measurement to be useful, it is related to the objectives & its all efforts are focussed to make the measures easy.

What are the Quality Attributes of Test Automation that should be measured?

While listing down the quality attributes for measurement, it is important for us to know your objectives against which we intend to measure these attributes. As one of the good practice we must not try to use all possible attributes that come to our mind. Rather it is better to choose three or four attributes that would give us the most useful information as to whether we are achieving our objectives or not.

Seven prime attributes of test automation are:

1) Efficiency
2) Maintainability
3) Reliability
4) Flexibility
5) Usability
6) Robustness
7) Portability

Kiviat diagram of a typical automation profile is shown in the following figure. Depending upon the objectives of the organization, each attribute is scored along the spokes of the diagram, with the better values being more away from the center.

Seven prime attributes of test automation
All these attributes along with their scales of measurement are described below.

1) Efficiency:
Efficiency is related to cost. Efficiency is generally one of the main reasons why people want to automate testing, to be able to perform their tests with less effort, or in a shorter time. Early automation efforts are likely to be less efficient than manual testing, but a mature automation profile should be more efficient than manual testing.

In order to measure test automation efficiency, we need to know about the cost of the automation effort. The cost of automating includes the salary and overhead cost of the people and the time and effort they spend in various activities related to test automation. It also includes the cost of hardware, software, and other physical resources needed to perform the automated tests.

The simplest measure is the cost of automated testing as a whole, which can then be monitored over time. Automated testing is composed of a number of different activities, which could be measured separately if more detail were required. Some activities, such as the design of new tests, would incur a similar cost whether the tests were executed manually or automatically. Other activities, such as test execution, will have a significantly different cost.

Following figure outlines how some aspects of testing may change when software testing managers introduce automation in stages.

 

Aspects of testing

Test execution consumes most of the effort In manual testing. If those tests are automated, the time taken for test execution should go down dramatically, but the cost of other activities may increase.

The second portion of the figure explains as to what happens when a set of test cases is automated. The time taken for test execution is significantly less for the automated tests, compared to the manual testing. However, maintaining the tests themselves before they are run on a later version of the software may take more effort for automated tests than for tests performed manually. This is because the manual testers can generally adjust the tests intuitively while they execute them. The necessary changes to automated tests have to be specifically and precisely implemented.

Setting up the environment and test data for automated tests needs very careful planning, which can consume a significant amount of time. If we are testing manually and find that a file is missing, we can get it. However if the tool finds that a file is missing during test execution, the test will fail. Although the automated set-up itself should be very quick, the effort to implement automated set-up will be higher than for manual testing.

The clear-up activities will probably be more extensive with automated testing than for manual testing, mainly due to the larger number of files that are created. The automated clear-up instructions also need to be debugged or subsequent tests may be affected. As with automated set-up, more effort will be needed in the planning.

Analyzing failures often takes significantly longer with automated tests. If we are testing manually, we know exactly where we have been and what has happened before a failure, so it doesn’t take long to find out what is wrong.

Above figure shows how trying to justify savings based only on test execution may be misleading, if the other test activities are not taken into account.

The third portion of the above figure shows what a more matured automation profile can look like. This should be our goal, but we can only say whether or not we have achieved a good profile if we measure it.

Scales of measurement of efficiency can be:

a) Elapsed time (hours) to perform certain tasks;

b) Effort (working hours) to perform certain tasks;

2) Maintainability:

It primarily refers to the ease of updating the testware when software undergoes changes. A highly maintainable automation profile is the one where it is easy to keep the tests in step with the software. It is a known fact that the software will certainly change. For majority of the organizations it is important that the effort of updating the automated tests should not be too high, or the entire test automation effort will be dropped in favor of a cheaper substitute of manual testing.

Scales of measurement of maintainability can be:

a) Average elapsed time in hours or effort in working hours per test to update the tests;

b) How often software changes take place.

We can measure the maintainability in more detail by considering different types of software changes like:

# Changes to the screen layout or the user interface.
# Changes to the business rules. It does not affect all the aspects of a test. e.g. a change in the interest rate as a business rule can affect the outputs without having any effect on the inputs.
# Changes to the format of a file or database.
# Changes to the content of a report.
# Changes in a communication protocol.
# Simple changes in the functionality. Minor change in the functionality should not have a major effect on the existing automated tests.|
# Major changes in the functionality. Major change in the software would certainly have a significant effect on the existing automated tests.

Thus it is important to make the tests easier to update for the most frequent changes in the software.

3) Reliability:
The reliability of an automated testing profile is related to its ability to give accurate and repeatable results.

Scales of measurement of reliability can be:

a) Percentages of tests that fail due to defects in the tests i.e. either test design defects or test automation defects;

b) Number of additional test cycles or iterations required because of defects in the tests;

c) Number of false negatives, where the test is recorded as failed but the actual outcome is correct. This could be due to incorrect expected results e.g. number of false positives, where the test is recorded as passed, but is later found to contain a defect not picked up by the test. This could be due to incorrect expected results, incorrect comparison, or the comparison incorrectly specified or implemented.

4) Flexibility:
The flexibility of an automated testing profile is related to the extent to which it allows us to work with different subsets of tests. For example, a more flexible profile will allow test cases to be combined in many different ways for different test objectives.

Scales of measurement of flexibility can be:

a) Time to test emergencies fix on an old release. e.g. a profile that allows this in two hours is more flexible than one that takes two days;

b) Time taken to identify a set of test cases for a specific purpose, e.g. all the tests that failed last time;

c) Number of selection criteria that can be used to identify a subset of test cases;

d) Time or effort needed to restore a test case that has been archived.

5) Usability:
There may be different usability requirements of an automated testing profile for different types of users, testers, or test automation engineers. E.g. a profile may be designed for use by software engineers with certain technical skills, and may need to be easy for those engineers to use. That same profile may not be usable by non-technical people. So usability must be considered in terms of the intended users of the regime.

Scales of measurement of usability can be:

a) Time taken to add, say twenty new test cases of a similar type to an existing profile;

b) Time or effort required to ascertain the results of running a set of automated test cases, e.g. how many passed and failed;

c) Training time needed for a user of the automation profile to become confident and productive. This may apply in different ways to the testers who design or execute the tests and to the test automation engineers who build the tests;

d) Time or effort needed to discount defects that are of no interest for a particular set of automated tests, e.g. a minor defect which is not going to be fixed until some future release;

e) How well the users like the profile, their perceptions of how easy it is for them to use it. This could be measured by a survey of the test automation users.

6) Robustness:
It refers to the ability of the testware to cope with unexpected events without tripping up. Robustness of an automated testing profile is how useful the automated tests are for unstable or rapidly changing software. A robust profile is able to cope up with more changes or with a wider variety of changes to the software. It will require few or no changes to the automated tests, and will be able to provide useful information even when there are a lot of defects in the software.

Scales of measurement of robustness can be:

a) Number of tests which fail because of a single software defect. A robust profile will have lesser number of tests failing rather than many tests failing due to the same reason;

b) Frequency of failure of an automated test i.e. failures due to unexpected events,

or the number of automated tests which fail for the same unexpected event,

or the number of automated tests which fail due to unexpected events compared to the number of unique defects found by that set of tests.

An unexpected event can be disconnection of a communication line etc.

c) Mean time to fail i.e. the average elapsed time from the start of a test until an unexpected event causes it to fail;

d) Time taken to investigate the causes of unexpected events that result in the test failure.

7) Portability:
The portability of an automated testing profile is related to its ability to run in different environments.

Scales of measurement of portability can be:

a) Time or effort needed to make a set of automated tests run successfully in a new environment (e.g. different database or management system) or on a new hardware platform;

b) Time or effort needed to make a set of automated tests run using a different test tool;

c) Number of different environments in which the automated tests will run.

Selection of Different Quality Attributes:
Depending upon the objectives of the organizations, the quality attributes are targeted according to their importance. Software testing managers while trying to set these objectives realize the fact that the objectives are not very well understood and may not be directly measurable at all.

1) For organizations working on dynamically changing software:
In case of dynamically changing software with frequent releases on many platforms, the most important attribute will be ease of maintenance of the tests.

When the software runs on different platforms, portability is also very important. In this case, it may not matter too much if the tests are not very reliable or robust, as the time saved in being able to test quickly gives the organization a better edge over its competition.

Occasional manual intervention is also acceptable in the automated tests.

2) For organizations with large number of technical tests:
When the technical tests are quite large in number, and where the software is very stable with minor changes from time to time and runs on just one platform, flexibility, reliability & robustness is of prime importance, whereas system may not demand greater usability, portability & maintainability.

3) For organizations preferring automation to begin with:
Automation profile using only capture replay aspect would be quite usable and reliable for such situations. Such an automation profile may not be too robust, and not flexible, maintainable, or portable in the initial few months of test automation but would not remain a good profile after a few years.

Conclusion:
1) Best way is to identify just 3 or 4 measures, which should be suitable for monitoring our testing, and test automation activities against the most important objectives.

2) Closely monitor these measures for few months & see what can be learnt from them.

3) We should not hesitate to change the things being measured if they are failing to provide some tangible information.

Many More articles on Test Automation Frameworks

Sharing is caring
Posted in Automation Frameworks, Automation Testing

Post navigation

Previous post
Know the Black-Box Software Testing Techniques to Test the Software Security
Next post
Best Practices of Test Automation Recommended by Software Testing Experts

WP Post Author

Yogindernath Gupta

An expert on R&D, Online Training and Publishing. He is M.Tech. (Honours) and is a part of the STG team since inception.

See author's posts

Quick Links to Our Knowledgebase
Interview Preparation
Interview Preparation Resources for Beginners to Experts
PMI PMP (Project Management Professional) Certification
PMI PMP Certification Préparation Ressources
PMI PMP Certification Exam Practice Question Papers
Study Material for ISTQB Certifications
Study Material - ISTQB Certified Tester Foundation Level Exam
Study Material - ISTQB Agile Tester Extension Level Exam
Study Material - ISTQB Certified Tester Advanced Level - All 3 Certifications
Keep track of latest posts by subscribing our RSS feed.You can also Subscribe by E-mail and get All New articles delivered directly to your Inbox.
Study Material for CSTE Certification
Complete Study Material-Certified Software Test Engineer-CSTE Certification Exam
Certifications on Reputed Automation Tools
Study Material - HP QTP / UFT Certification Exam
Study Material - HP QC / ALM Certification Exam
Study Material - HP LoadRunner Certification Exam
Study Material - IBM Rational Functional Tester - RFT Certification Exam
Quick Navigation Sitemap of SoftwareTestingGenius

Get your Absolutely Free Copy of Several Presentations & E-Books related to ISTQB, HP QTP/UFT, Load Runner, RFT and many more Certification Exams, prepared by Expert & Trainers, by writing to: Software.testing.genius@gmail.com

Leave a Reply

avatar
This comment form is under antispam protection
avatar
This comment form is under antispam protection
  Subscribe  
Notify of

Advertisements

  • Popular
  • Recent
Consolidated Study Material-QTP and QC Certification Exams
ISTQB Certification Study Material
HP Brings New Certification Exams for QTP 11.0 & QC 11.0 from July 2011
Quality Center Certification Skill Test:Q. 1 to 10
ISTQB Foundation Level Exam Crash Course Part-1
What is Selenium – Introduction to Selenium Automation Tool
An Introduction to all new Selenium IDE
Download & Install Selenium IDE
Selenium Automation Tutorial – Firebug & FirePath addons are not longer supported in Firefox
What Software Testers can do to Prepare for the Next Recession?

About Us
Know more about Software Testing Genius!
Contact Us
Start a conversation with our team of experts!
Easy Navigation Sitemap
Quickly navigate through Software Testing Genius!

Privacy Policy
Copyright Policy
Online Conduct

Advertise
Promote your Website, Product or Services!
QTP/UFT Training
Get Online Training From HP Certified Experts!
Software Testing Service
Outsource your testing requirements to us!
Connect with us
Latest Posts
  • What Software Testers can do to Prepare for the Next Recession?
  • An Insight to Project Management – A Short Primer for Novice to Experts
  • New Techniques emerging out of the Fourth Industrial Revolution
  • What is Katalon Studio and How to Use it
  • Quick Start to preparation for ISTQB Agile Tester Extension Exam

Free & Best Study Material

  • ISTQB Certification Foundation & Advanced
  • QTP Certification (UFT 11.5) & ALM
  • HP Load Runner 12.x
  • IBM Rational Functional Tester (000-842)

Copyscape Protection

Copyright © 2008 - 2019 Software Testing Genius

Web Cohort: Corporate Network Executions

wpDiscuz