Erik and I met with a consultant from TechSquare Friday afternoon, who helped us get the OpenPBS/Torque queue system working, and more importantly, explained what exactly what was going on. I'd like to thank Erik for his help coordinating this.
We're now ready to start using the queue system. I would appreciate it if you started your next jobs in the queue system. The transition period may be a bit awkward, until all the previously started jobs are finished, but the system does sometimes notice a full (outside the queues) node and avoid running there.
The full instructions to get started cover a lot of material; please read through them at the group computational page: Policies and Queuing System
Please take special note that some nodes on Cyrus1 (n017 through n021) are reserved for non-queuable work (e.g. Accelrys software, if we can't get it working).
If you have any questions about this, you can contact me, or comment on the Wiki.