Autotest Weekly Report

Autotest Weekly Report

Reported by: 12/16/2013

What I Did Last Week

• Debug autotest scripts of ‘smart search’ which have existed before but not work, all can run normally now.
• Modify autotest scripts of ‘Smart Search’. In order to add the script of ‘smart search’ to current autotest framework, every step of the scripts need to be modified according unified naming rule, so that it can generate normative report and will be convenience for testers to understand autotest report and analyze it easily in future.

          Part scripts have been modified now, ongoing this week.

 

Brief Introduction About Autotest

• Autotest tool:  Jmeter
• Test category:  Interface test
• Origin of autotest:  Former colleagues have developed part scripts of CIM using Jmeter.
• The time I begin to take over:  2013.8.19
• Projects (automation finished):  Direct-AWS-IWT Integration
• Projects (automation in progress): CIM
• Basis of test case:

           Direct-AWS-IWT Integration:< http://testszpc.autotest.com/Help > provided by developers.

           CIM: <Smoke test case of CIM.xlsx> provided by manual testers.

 

Autotest Coverage Overview

• Direct-AWS-IWT Integration Autotest

          6 interfaces, 100% covered, Only check the format of reply message and the content of newly added items in reply message.

• CIM Autotest

           80% covered

Run Mode Of Autotest

• Time to start on VM ‘SZOTWIN2K801’ automatically every day. CIM autotest starts at 9:00 AM, Direct-AWS-IWT Integration starts at 10:00 AM.
• To release or patch, manual testers can start the autotest by double click the shortcut on desktop of VM ‘SZOTWIN2K801’.
• To choose TP or LIVE, modify the host file according to manual testers’ need.
• Either automatically or manually autotest starts, it will be completed within a few minutes and send mail with autotest report to personnel automatically.

Improvement Of Autotest Framework

• Start autotest in interface mode, so that it can be started automatically on time or manually at any time.
• Organize scattered autotest cases together and orderly with ant and jmeter, so that it is easy for anybody to execute all the autotest scripts by double click the shortcut on desktop.
• Generate autotest report automatically after autotest execution, including full report and the tidy report that contains only the summary and wrong information.
• Send email in the form of content with the link of full report and the tidy report.
• To execute the whole *.jmx file again automatically when any step in which gets failed, up to 3 times.
• Keep only the report within 7 days, delete the report generated 7 days ago automatically.