Next CHAPTER 11 Testing

CHAPTER 11

11.0 Testing

Testing is the filter to catch defects before they are “discovered” by the customer or end user. Every time a customer runs the program, he/she generates a “test-case”. We tried the test cases to find the defects first since software development is a human activity and there may be potential errors. So testing before the product is delivered helped us to assure the quality and saved resources.

11.1 Testing Objective

Objective of testing is to find errors, demonstrate that software functions that satisfy the specification, reduce the number of errors detected by customer, have “confidence” in the software system. A good test always tries to discover undetected errors and is successful when errors are found since zero defects is not possible. There is always a condition or usage that can lead to an incorrect behavior.

11.2 Testing Steps

We started testing each individual new component and worked out as unit test, integration test, high order test, customer acceptance testing and different testing techniques are used at different times in the process.

11.3 Testing Techniques

Following testing techniques are used.

11.3.1 White Box Testing

In white box testing we exercises the internal logic of a program, examine internal program structure and derived tests from an examination of the program’s logic, tested internal paths and working of the software. To perform this we used to develop test cases for unit and integration testing.

11.3.2 Black Box Testing

In black box testing we exercises the input and output requirements of a program, tested by conducting specifications of requirement for which the software should do. This test is derived from the I/O specification and used in most functional tests.

11.4 White Box Strategies

White box testing strategies uses the control structure of the program and design to derive test cases.

11.4.1 Basis Path Testing

Test cases are derived to exercise the basis set that guarantee that every statement in the program is executed at least once during testing. It is applied in series of steps.

Test case for login button of the login form:

Test case 1: All the following combinations are tested

Password is valid and Username is valid

Password is valid and Username is invalid

Password is invalid and Username is invalid

Password is invalid and Username is valid

Expected results: No error crossing this stage when Password & Username are both permissible combination of characters. In all other case error message is displayed.

Test case 2: Following input combination is tried where permissible set of characters for username & password are entered which are non-existent in table.

Password is valid, existent and Username is valid, existent

Password is valid, existent and Username is valid, nonexistent

Password is valid, nonexistent and Username is valid, existent

Password is valid, nonexistent and Username is valid, nonexistent

Expected Results: if no entry into the system then error message displayed. And user is linked to the registration page.

Test Case 3: To test this both username & password to be entered must be valid & existent in the registration table.

Password = Valid, Existent and Username = Valid, Existent

Similarly all the other internal paths & logic can be tested.

11.4.2 Control Structure Testing

Condition testing

Condition testing is a test case design method that exercises the logical conditions contained in a program module. If a condition is incorrect, then at least one of the conditions is incorrect. So, types of errors in a condition include Boolean operator error (incorrect/missing/extra Boolean operators), Boolean variable error, Boolean parenthesis error, relational operator error and arithmetic expression error. It mainly focuses on testing each condition in the program. The condition testing strategies to be employed are:

Branch testing: For a compound condition C, the true and false branches of C and every simple condition in C need to be executed at least once.

Domain testing: It requires three or four tests to be derived for a relational expression. For a relational expression of the form

E1 <relational operator> E2

Three tests are required to make the value of E1 greater than, equal to, or less than that of E2.

Boolean Expression testing: A condition without relational expression with n variables, all of 2ⁿ possible tests are required provided n > 0. This strategy can detect boolean operator, variable, and parenthesis errors, but it is practical only if n is small.

Loop testing

Loops are cornerstone for the vast majority of all algorithms implemented in software. Loop testing focuses exclusively on the validity of loop constructs. Testing approach for different types of loops is listed below.

Simple loops: The following set of tests will be applied to simple loops, where n is the maximum number of allowable passes through the loop.

· Skip the loop entirely

· Only one pass through the loop

· Two passes through the loop

· m passes through the loop where m < n

· n – 1, n, n + 1 passes through the loop.

Nested loops: Simple loop testing strategy if applied to the nested loops will increase the no. of possible tests geometrically. Approach for nested loops are:

· Start at the innermost loop. Set all other loops to minimum values

· Conduct simple loop tests for the innermost loop while holding the outer loops at their minimum iteration parameter values. Add other tests for out-of-range or excluded values.

· Work outward, conducting tests for the next loop, but keep all other outer loops at minimum values and other nested loops to typical values.

· Continue till all loops have been tested.

Concatenated loops: When concatenated loops are independent then approach for simple loop was applied & if they happen to be dependent the nested loop approach was applied.

Unstructured loops: This class of loops was redesigned to reflect the use of the structured programming constructs.

11.5 Black Box Strategies

Black Box testing strategy focuses on the functional requirements of the software without any regard to the internal structure. It is used in most system level testing where functional, performance, recovery and security & stress are main issues. This applied strategy finds errors in incorrect or missing functions (compared to white box), interface errors, errors in external data structures and in behavior performance problems (Combinations of input make it behave poorly). It also finds errors in initialization and termination (Sensitive to certain inputs (e.g. performance). It is performed much later in process than white box...

A test strategy that uses every possible input condition as a test case would be ideal but is not possible. We apply following Black-Box Testing Strategies.

11.5.1 Graph Based Testing

The first step in black box testing is to understand the objects that are modeled in software and the relationships that connect the objects. Once this has been accomplished, the next step is to define a series of tests that verify all objects that have the expected relationship with another.

11.5.2 Equivalence Partitioning

It is a black-box testing method that divides the input domain of a program into classes of data from which test cases can be derived. It reduces, by more than one, the number of test cases that must be developed since one test case might uncover a class of errors. It covers a large set of other possible test cases hence helps reduce the number of inputs. Incorrect processing of all integer number is detected.

Identifying Equivalence Classes: Each input condition (a sentence or phrase in the specification) is taken & divided into 2 or more classes as valid equivalence class and invalid equivalence class.

Rules for Equivalence Classes:

Range - If an input condition specifies a range (i.e. n is an integer from 1 to 10) then

i) 1 valid (if 1<= n and <= 1000)

ii) 2 invalid (if n < 1 and > 1000)

Specified Value - An input condition specifies a specific value e.g. 10 character string then

i) 1 valid (10 character string)

ii) 2 invalid (any character string less than 10)

Value Set - If the input specifies a set of valid values, then

i) 1 valid condition within the set.

ii) 1 invalid condition outside the set.

Boolean - If an input condition specifies a “must be” situation (e.g. either Yes or No) then

i) 1 valid (if Yes).

ii) 1 invalid (else No).

11.5.3 Boundary Value Analysis

It is a test case design technique that complements equivalence partitioning, by selecting test cases at the “edges” of the class. Greater no. Of errors tends to occur at the boundaries of the input domain rather than in the “Center”. Rather than any element in class, BVA selects tests at the edge of the class. In addition to input condition, test cases can be derived for output conditions. Similar to Equivalence partitioning, BVA, equivalence classes are identified first then boundaries.

Some guidelines for BVA:

1. If an input condition specifies a range bounded by values a and b then test cases will be designed with values a and b and just above and just below a and b.

2. If an input condition specifies a number of values, test cases will be developed that exercise the minimum and maximum numbers. Values just above and just below minimum and maximum are also tested.

These 2 guidelines are also applied to the output conditions. Designing test case to exercise the data structure at its boundary will test boundaries prescribed on internal program data structures.

11.5.4TESTING STRATEGIES FOR WEB APPLICATION

The approach of web app testing adopts the basic principle for all

Software testing and applies a strategy and tactics that have been

Recommended for object oriented system .the following steps

Summarizes the approach:

1. The content model for the web app is reviewed to uncover errors.

This is like copyediting

2. The design model for the web application as reviewed to uncover navigation error.

Use cases derived as part of the analyst activity, allow a web engineer to exercise each usage scenario against the architectural and navigational design. These non executable test help uncover error in navigation.

3. Selected processing component and web page is unit tested.

When web apps are considered, the concepts of the unit changes,

Each web page encapsulated in itself content navigation link as Well

As script, form and applet (processing element). It is not always

Possible or practical to test each of these characteristics individually.

4.The architecture is constructed and integration tests are

Conducted.

The strategy for integration testing depend upon the architecture that has been chosen for the web application

5.The assembled web application is tested for overall functionality

and content delivery.

Like conventional validation, the validation of web based systems and application focuses on user visible action and user recognizable output from the system. To assist in the derivation of validation tests the tester should draw upon use cases the use cases provides a scenario that has high likelihood of uncovering errors in user interaction requirement.

6. The web application is implemented in a variety of different

Environmental configuration and is tested for compatibility with each configuration.

7. The web application is tested by controlled and monitored

Population of end user.

Finally with the modular concept inside the application it is being

also tested for its Reliability:

The system reliability will be insured through data integrity rules

built into the database at the backend and the system rules built

into the front-end application. The system will take assurance from

the user before making any changes permanent.

MAINTAINABILITY:

The system has been designed taking care of modularity. Faults in

the system can be traced to modules and thus

VALIDATION CHECKS

This will be as such to maintain consistent and persistent

Information on the web when most of the time the project has to

Deal With uploads so a minor error will down the impression of the

Company. Therefore, validation checks by software itself using the

Flavors of JavaScript and manual checks are also necessary as: -1.Correct entry of data in the form.

2.Correct updating of question and with the most suitable answer etc.