ZIPS maintains a software test framework aimed initially at reliability, conformance, security, and build testing of software under development or maintenance by ZIPS and ZEST.
Features:
- nightly functionality testing of SOAP/RPC web services
- nightly load testing of same
- future: nightly builds of application software
- future: automated jabber server testing
Infrastructure:
- fast RHEL4 machine in W91 colo space
- Apache JMeter 2.2 for automated "production" testing
- tcpmon and PushToTest's TestMaker 4.4 for experimental test development
Observations on the Process:
Testing breaks things. They need to get fixed. (Yes, very deep obversations here.) Flexible test frameworks for fine-grained testing and good intereaction between testers and developers (if they're not the same people) are essential.