software testing genius

Pros and Cons of Data-driven versus Keyword-driven Automation Frameworks

Welcome to “Software Testing Genius”. Subscribe to my RSS feed for latest content on Software Testing.

Download Link for your Favorite E-Book is at the End of this Page
Pros & Cons of Data-driven versus Keyword-driven Automation Frameworks

Many types of test automation frameworks are being practiced by the industry. There are several benefits / drawbacks of each one of them. However it depends upon the testing expert as to how he/she makes the selection based upon many considerations of reusability of test scripts and all other test assets.

Here we shall try to differentiate between Data-driven Framework and Keyword-driven or Table-driven Framework.

Data-Driven Testing Framework:
In data-driven testing the input and output values for the test are fetched from data files. These data files can be Excel files, CVS files, ADO objects, DAO objects

or any ODBC source etc. Subsequently these get loaded into various variables in scripts which might be either manually created or can be captured ones.

For input values as well as output verification values, variables are used in data-driven framework. The test scripts contain all the coded information regarding reading of the data files, navigation through the application & test status logs etc.

This has a similarity with table-driven testing in a way that our test case is encapsulated in the data file as against in the test script. The test script just remains a "driver," or a means of delivery for the data. Here in data-driven testing, data files contain just the test data only.

Advantages of data-driven testing:

The advantages of the Data-Driven test automation framework are as under:

a) We can create our scripts even when development of application is still going on.

b) Redundancy & unnecessary duplication of creation of automated testing scripts gets greatly reduced due to the modular type of design & due to the use of files or records for both input as well as verifying the data.

c) In case of any change in functionality, we just need to revise the particular "Business Function" script.

d) Information like data inputs or outputs, expected results get stored in the form of conveniently managed text records.

e) This permits better error handling, thereby the resulting test scripts are more robust. This is due to the fact that when a script is called, the functions return "TRUE" or "FALSE" values, instead of aborting. By having a nicely created "recovery" program, we can execute our test scripts virtually unattended.

Disadvantages of data-driven testing

The disadvantages of the Data-Driven test automation framework are as under:

a) This calls for great expertise of scripting language required by the automation tool.

b) For every test case we need many data-files. According to the number of screens being accessed we may have many data-inputs and may require many verifications. Hence the test case needs to keep the data-files in different directories.

c) The test engineer is required to re-enter the test plan data in various concerned data files in addition to managing the detailed test plan.

d) In case for creating & maintaining the data-files, we use text editor like Notepad, extra care is needed in having the desired format needed by the functions or scripts which would process the concerned files; otherwise we shall get script-processing errors due to incorrect data-file format or its content.

Keyword-Driven Testing Framework:
In keyword driven framework we need to create a set of keywords & data tables, which are not dependent either on the test automation tool being used by us or on the test scripts driving the data & the application under test.

Keyword-driven tests have large resemblance with manual test cases.

In a keyword driven framework, the entire functionality of our application under test gets captured as step by step instructions for every test as well as in a table. In a keyword driven framework, the complete functionality as well as the process is data-driven.

Advantages of keyword driven testing:

The advantages of the Keyword Driven Testing are as under:

a) We can write the detailed test plan having desired inputs and verification data in the form of simple & convenient spreadsheets.

b) In case some expert having expertise of scripting language used by the automation tool, can create utility scripts well before the creation of the detailed test plan, then the testing engineer is able to use the Automation Tool immediately through the spreadsheet input method & for this he/she need not master the concerned scripting language actually used by the automation tool.

c) The testing engineer becomes productive with the new testing tool far quickly, since he/she is required to understand the particular format for use in the test plan & various desired Key Words. This permits deferment / rescheduling of more exhaustive training on new tool at some more convenient time in future.

Disadvantages of keyword driven testing:

The disadvantages of the Keyword Driven Testing are as under:

a) The tester is required to have great expertise over the scripting language of the test tool, so that he/she can successfully create customized functions and utilities required for the particular application. Although this statement is valid for all other methods as well.

b) The tester is required to learn several special formats & keywords for creating the customized utilities required for the application. This process can take considerable time & can have adverse effect on the test plan development. However these problems arise in the beginning only, and when the test engineers get enough acquaintance with the process, they are able to create test cases much faster.

In actual practice, what has been seen is that people land up with implementation of a framework, which happens to be an amalgam of all both these techniques, by taking advantage out of their strong points & intelligently tackling their weaknesses.

By & large majority of frameworks turn out to be such a hybrid framework over a passage of time. Such hybrid frameworks utilizing keyword-driven testing & data-driven test scripts tend to be more successful in test automation.

Many More articles on Test Automation Frameworks

Study Material - HP QTP & QC Certification Exams

Study Material - IBM RFT Certification Exam

Study Material - HP LoadRunner Certification Exams for All Modules

Study Material - ISTQB Certification Exam

What Successful Testers say about the Quality of this website

If you want to keep track of further articles on Software Testing,
I suggest you to subscribe my
RSS feed

You can also Subscribe by E-mail
and get All New articles delivered directly to your Inbox.

Quick Navigation of Software Testing Genius

Get your Absolutely Free Copy of Several MS PowerPoint Presentations & E-Books related to ISTQB, HP Load Runner, IBM RFT, HP QTP & QC Certification Exams, prepared by Popular Writers & Trainers, by writing to:

Full Study Material for ISTQB Certification Exams:

Largest Database of Sample Papers - 1000+ Unique Questions for ISTQB Foundation Exam

ISTQB Foundation Exam - Full Crash Course for Download

ISTQB Advanced CTAL Test Analysts Exam - Full Crash Course for Download

ISTQB Advanced CTAL Test Manager Exam - Full Crash Course for Download

Most Popular Topics in Demand:

Practical Roadmap to QTP Certification

Practical Roadmap to CSTE Certification

Consolidated Study Material - Testing & QA

Rehearsal of QTP in 1 Hr. -  Interview Questions

Download Link to your Favorite Ebook:

ISTQB Advanced Level Certification Exam Self Study E-Book

Comments :


# 1 Uday Kumar on 2009-08-21 14:00:49

The document is not clear.

Better if you explain the concept with an example. Because people reading this concept may not have basic idea behind these frameworks.

I feel it can be better understand if you explain with example.

Looking forward from you.


# 2 Ram Kumar on 2009-08-22 04:14:15
Hi Genius

This article drawing comarison between Datadriven and keywordriven testing is sharply focused. Wonderful.

Thanks for the nice post !!!

# 3 shiva on 2009-09-07 12:44:01
nice article, me too tring to write few articles on testing here is one on data driven framework with few examples review and tell me whether i am wrong at any point or to add more

# 4 Krishna Mohan T on 2010-04-08 23:59:12

This article is very informative with clear comparison of both frameworks. Article is precise and is covering all required aspects of framework development. Taking an example might be helpful in understanding the essence of this article in full.

Great Job !

Krishna Mohan T
Test Engineer

# 5 Madhavi on 2010-07-27 13:52:01
Hi ,

It would be a great help if anyone ca provide a set of sample question paper for ISTQB Advanced Level Test Analyst Exam.

Thanks in advanced !


# 6 Guru on 2011-12-29 05:30:39

As i have some basic knowledge in keyword driven even though i could not understand what is the objective.
some of the points were able to understand.but few things were not cleat.if you could give some more descriptive clarification with small example it better.


Leave Your Comments: (*) Marked Fields are Mandatory

You can apply basic formatting to the text

Name *
Email Address *
Speak your mind
sex hikayeleri