ZIPS maintains a software test framework aimed initially at reliability, conformance, security, and build testing of software under development or maintenance by ZIPS and ZEST.

Features:

• nightly functionality testing of SOAP/RPC web services
• nightly load testing of same
• future: nightly builds of application software
• future: automated jabber server testing

Infrastructure:

• fast RHEL4 machine in W91 colo space
• Apache JMeter 2.2 for automated "production" testing
• tcpmon and PushToTest's TestMaker 4.4 for experimental  test development

Observations on the Process:

Testing breaks things.  They need to get fixed.  (Yes, very deep obversations here.)  Flexible test frameworks for fine-grained testing and good intereaction between testers and developers (if they're not the same people) are essential.