Rx - RIExerciser - Home Networking Testing Tool

Rx Project Overview:

The RxProject is an effort to take the current DvrExerciser OCAP Xlet and refactor it into a frame work which provides the following:

A library of functionality which aggregates OCAP API calls into functional building blocks provided by RI Stack & PC Platform.
A scripting interface which allows automation of testing of these functional building blocks.
A "Guide" Type OCAP Xlet which is referred to as the RxExerciser which supports functional/application level testing and development through a GUI.

Rx Project Management:

Meeting Agenda for Monday, Dec. 12th

Progress on the smoke test rework – launching, monitoring and reporting of bean shell scripts framework – Parthi & Steve A
Current status of RiExerciser - Nicolas
Current status of automating HN Streaming Tests – Parthi
Discuss plan for upcoming week – who will be working on what

Meeting Agenda & Minutes for Wednesday, Dec. 7th

Purpose of this meeting was to address the following questions related to running tests:

How is a test started?

It was decided that the existing RiScriptlet command line arg that initiates running a single bean shell script is sufficient. If a more complicated scenario is desired, such as run this test 10 times, the logic will be placed into a single bean shell script. TestLink will use this same mechanism of a single script and will use the same bean shell scripts which are checked into svn. The purpose of TestLink will be to launch single bean shell script and act as the clerk to archive the tests.

How is test progress tracked?

It was decided that logs could be monitored will executing but only progress that is "reported" is when the scripts completes. This will be done by terminating/resetting the RI. Only indication will be that the script has completed is when the RI exits.

How are test results obtained?

It was decided the test results will be in the log. The RiScriptlet will generate log messages in an expected format and include bean shell calling chain. A utility such as grep will be used to post-process the results.

Action Items & Assignees

Steve A. – modify RiScriptlet to do the following:
1. Support a command line arg requesting the RI be terminated via telnet port 2300 in order to know test has completed
2. Modify RIScriptlet to use a well-known format for logging output from bean shells to facilitate processing of test results
3. Include calling chain of bean shells as part of RiScriptlet logging
Parthi -- investigate infrastructure to support running bean shell level 3 scripts from TestLink/Maven (confirm that nightly an script is not needed)

Current Project Status:

Finish UI implementation for Phase 1 and work on RiScriptlet scripts, focusing on HN streaming tests.

Current Project Related Tasks & Assignees

Steve M. - 25% allocation to RxProject, continue supporting OcapAppDriver development
Parthi - continue with script development, focusing on HN streaming test cases
Nicolas - get Phase 1 support in RiExerciser
Steve A - assist in Phase 1 RiExerciser development
Scott A - get nightly test script setup and running

Rx Project Weekly Monday Meeting Agenda & Notes