Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Automated Application Tests
     for Lotus Notes

                     or

 How to rest easy during the next roll out




...
About us

  Lucius Bobikiewicz                    Christian Klümper




  Managing Director                     Head of te...
Live Demo of AutoUser
QA for complex or mission-critical
Lotus Notes applications


       • Function tests
          o Dependencies
          o...
QA based on automated tests
provides significant advantages

   • Reliable
     No human errors when working through the Q...
Case study: Automated tests for mission-
critical software at proClients GmbH

Application to be tested:       Domino Stor...
Case study: proClients GmbH




Domino Storage Optimizer (DSO)

    • Reduces data volume in Notes databases dramatically ...
Case study: proClients GmbH


System architecture of Domino Storage
Optimizer

        Domino
        Server
             ...
Case study: proClients GmbH


DSO vs. DAOS
(1 Domino cluster with 2 x 1 terabyte)
                    DAOS                ...
Case study: proClients GmbH


      The test scenario for DSO

                                                   80 Test
...
Case study: proClients GmbH



Our QA approach for DSO


       • 80 defined test cases with detailed 
          o start c...
Case study: proClients GmbH


Architecture of the automated test system


                                                ...
Case study: proClients GmbH


Automated testing is ~8 to 10 times faster

            • Manual testing

                  ...
Case study: proClients GmbH

AutoUser enables, for the first time,
full-scale testing for every build
              Not an...
Case study: proClients GmbH


Amortisation will be achieved
after one single test run

       Tasks
        • creating a l...
Case study: proClients GmbH



    Lessons learned

    • Administration of test cases / test definitions (not scripts) re...
Case study: proClients GmbH


Impact on the future development
processes at proClients GmbH
After having implemented the "...
Smart-Toucan's AutoUser


    • can dramatically reduce costs for executing test case

 
    • enables completely new QA s...
Thank you
Upcoming SlideShare
Loading in …5
×

Automated Application Tests For Lotus Notes Uklug 2009

2,273 views

Published on

Automated function and regression tests for Lotus Notes applications:

* Workflow tests: Test complete workflows, including automated switching of user IDs and integrated handling of e-mails and doclinks
* Load tests: Measure how your application will scale before you roll it outt
* Performance measuring: Collect hard data on performance issues by sending executable test scripts to your users
* Cross-client testing: Check how your current applications will work in new Notes clients or Domino versions
* Powerful scripting language: Based on an enhanced VBScript dialect
* Log files: Record the results of test runs and store them back into your QA databases

Published in: Automotive, Technology, Business
  • Writing good research paper is quite easy and very difficult simultaneously. It depends on the individual skill set also. You can get help from research paper writing. Check out, please ⇒ www.HelpWriting.net ⇐
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • D0WNL0AD FULL ▶ ▶ ▶ ▶ http://1url.pw/eGL6e ◀ ◀ ◀ ◀
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • D0WNL0AD FULL ▶ ▶ ▶ ▶ http://1url.pw/eGL6e ◀ ◀ ◀ ◀
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

Automated Application Tests For Lotus Notes Uklug 2009

  1. 1. Automated Application Tests for Lotus Notes or How to rest easy during the next roll out Oct. 7 2009, Sponsor Session
  2. 2. About us Lucius Bobikiewicz Christian Klümper Managing Director Head of test management & test Smart-Toucan GmbH development at proClients GmbH Lucius.Bobikiewicz@Smart-Toucan.com Christian.Kluemper@proClients.de www.smart-toucan.com www.proClients.com
  3. 3. Live Demo of AutoUser
  4. 4. QA for complex or mission-critical Lotus Notes applications • Function tests o Dependencies o Workflow tests o Role permissions   • Load test     Improve your database design before launching it   • Performance tests Live monitoring 24/7 - exchange vague user feedback for hard data
  5. 5. QA based on automated tests provides significant advantages • Reliable No human errors when working through the QA case manual • Fast Automated testing is significantly faster than manual testing • Repeatable Tests can be executed as often as needed, no manpower bottleneck • Verifiable and traceable You get machine-generated, reproducible results  (Sarbanes-Oxley anyone??)
  6. 6. Case study: Automated tests for mission- critical software at proClients GmbH Application to be tested:       Domino Storage Optimizer Installations (Example):         DFS/German Flight Control QA level required:                  High Responsible QA Engineer:    Christian Klümper
  7. 7. Case study: proClients GmbH Domino Storage Optimizer (DSO) • Reduces data volume in Notes databases dramatically - approximately 80% of data volume for mail databases are allocated for mail attachments   • DSO moves attachments from Domino applications to the storage system Centera by EMC²   • Identical attachments will be stored only once but referenced as often as needed   • Automated restoration of attachments at runtime when user reopens an optimised document
  8. 8. Case study: proClients GmbH System architecture of Domino Storage Optimizer Domino Server CLIP CLIP CLIP DSO Centera-API                   Centera CLIP CLIP
  9. 9. Case study: proClients GmbH DSO vs. DAOS (1 Domino cluster with 2 x 1 terabyte) DAOS DSO Server 1 Server 2 Server 1 Server 2 300 GB data 300 GB data 300 GB data 300 GB data in databases in databases in databases in databases 350 GB data 350 GB data in DAOS in DAOS 350 GB data in Centera 1,300 GB to be backed up 600 GB to be backed up 700 GB less to back up - every day!
  10. 10. Case study: proClients GmbH The test scenario for DSO 80 Test Cases 4 Clients 4 OS 3 Domino Versions 6.5 6.5 7.0.3 2,880 3x 4x 4x 80  =  Tests 7.0.3 8.0.2 8.5 8.5 basic
  11. 11. Case study: proClients GmbH Our QA approach for DSO • 80 defined test cases with detailed  o start conditions o actions to be performed o expected results • 5 categories of test cases o document actions o deletion actions o attachment actions o mailing actions o database actions   • Outcome of all tests runs are recorded, history is traceable
  12. 12. Case study: proClients GmbH Architecture of the automated test system AutoUser applies tests on target Testscripts are application stored within and started from a Notes Database Results are written into txt And stored back files or directly into the Notes test into Notes database documents
  13. 13. Case study: proClients GmbH Automated testing is ~8 to 10 times faster • Manual testing     80 tests require 12 hours     All 2,880 tests required (*) 54.0 days • Automated testing     80 test take 1.5 hours     All 2,880 test take 2.2 days (*) in manual testing we calculate 8h per work day
  14. 14. Case study: proClients GmbH AutoUser enables, for the first time, full-scale testing for every build Not an option: No problem at all: 50 testers working  Running night shift 4 PCs
  15. 15. Case study: proClients GmbH Amortisation will be achieved after one single test run Tasks • creating a library with general test functions • writing control scripts for all test case categories • integrating these scripts into the test case database Total investment for implementation • about 500 to 600 hours   Amortization •  one (1!) complete test run of the  2,880 testcases almost amortises the investment
  16. 16. Case study: proClients GmbH Lessons learned • Administration of test cases / test definitions (not scripts) requires a tool of its own (at proClients, this is a Notes database)   • A single repository helps a lot. We store test definitions, scripts, and results into a single, centralised database.   • Test execution should be as flexible as possible, run o all test cases o only test cases of one category o only one single test case   • Test libraries also need to be designed Maintenance and integration of new tests should be a no-brainer 
  17. 17. Case study: proClients GmbH Impact on the future development processes at proClients GmbH After having implemented the "basic" test scenario, we are going to: • Increase the number of tests • Enhance the complexity of tests • Implement additional test scenarios • Set up auto-execution for all cases in all scenarios • Implement load tests • Set up continuous performance monitoring  QA has now turned from bug searching into an active process of improving the quality of our software!
  18. 18. Smart-Toucan's AutoUser • can dramatically reduce costs for executing test case   • enables completely new QA strategies    • provides new business oportunities for IBM partners                For more information, please contact: Lucius Bobikiewicz@Smart-Toucan.com (For more information on DSO, meet Christian at the Smart-Toucan booth)
  19. 19. Thank you

×