...
On the production Roles server (roles.mit.edu, aka cloverleaf) and the test Roles server (roles-test.mit.edu, aka parsley), there are several sets of data feed jobs that are automatically run each day. The overall schedule can be found in the crontab file:
- Production: ~rolesdb/cronjobs/crontab.cloverleaf
- Test: ~rolesdb/cronjobs/crontab.parsley
If you ever need to change the crontab file, do the following:
- Connect to the server machine using telnet or SSH as user rolesdb.
- Go to the cronjobs directory
cd cronjobs - Check out the crontab file from RCS using the alias "checkout"
checkout crontab.cloverleaf
(or)
checkout crontab.parsley - Use emacs or vi to make the desired changes
- Check in the new crontab file into RCS using the alias "checkin"
checkin crontab.cloverleaf
(or)
checkin crontab.parsley - **** Don't forget this step! *** Run the crontab command.
crontab crontab.cloverleaf
(or)
crontab crontab.parsley
...
morning_jobs_early | - Extracts most data from the Warehouse, including most types of Qualifiers, and does some processing for the Master Department Hierarchy |
morning_jobs_late | - Runs some steps that depend on PERSON data from |
...
the Warehouse including (a) loading the PERSON table |
...
from krb_person@warehouse, (b) loading EHS-related |
...
Room Set data from the Warehouse into RSET |
...
qualifiers, (c) processing externally-derived |
...
authorizations (table EXTERNAL_AUTH). |
cron_run_exception_notify | - Generates Email about Authorizations that |
...
still exist for people with deactivated |
...
Kerberos usernames |
weekend_jobs | - Runs a procedure to run an Oracle ANALYZE on all |
...
the tables in the Role DB. |
hourly_jobs | - Currently only runs once a day, not hourly. |
...
Updates derived database tables ("shadow" tables) |
...
for the Master Department Hierarchy |
cron_roles_cleanup_archive | - Cleans up some old files in the archive |
...
directory |
cron_run_sapfeed | - Runs a job to create several daily files about |
...
SAP-related authorizations and uses the scp |
...
command to copy them to a directory on one of the |
...
SAP servers where they are picked up, further |
...
processed, and loaded into the appropriate SAP |
...
objects. The files built and sent are incremental, |
...
including authorization information only for those |
...
people whose "expanded" authorizations (after |
...
including all child qualifiers) have changed since |
...
the previous run. |
cron_pdorg_prog.sh | - Compares SAP-related approver authorizations |
...
in the Roles DB with parallel information in the |
...
pd org structures in SAP, and generates a file |
...
indicating differences. |
cron_pddiff_feed.sh | - Sends the file pdorg_roles.compare, generated from |
...
cron_pdorg_prog.sh, to the SAP dropbox |
cron_ehs_extract run_ehs_role_prog.pl | - Runs ~rolesdb/bin/ehs/run_ehs_role_prog.pl to |
...
compare DLC-level EHS roles (e.g., DEPARTMENTAL |
...
EHS COORDINATOR) to their equivalent Authorizations |
...
in the Roles DB (which is the system of record), |
...
generates a differences file, and sends it to |
...
the SAP dropbox so the changes can be applied. |
Directories
Directory | Description |
|---|---|
~rolesdb/archive | Some compressed historical files from previous days' data feed runs |
~rolesdb/bin | Generic data feed perl scripts and other program files |
~rolesdb/bin/ehs | EHS-related data feed programs |
~rolesdb/bin/extract | Programs related to out-going data for DACCA, LDS (SAP component being phased out), etc. |
~rolesdb/bin/pdorg | Programs related to out-going data for updating PD Org entries in SAP related to APPROVER authorizations |
~rolesdb/bin/repa_feed | Temporary or test versions of programs |
~rolesdb/bin/roles_feed | Most data feed programs for data coming into the Roles DB |
~rolesdb/data | Data files used by data feed programs. Most data files are temporary, but some, such as roles_person_extra.dat, are permanent. |
~rolesdb/doc | Miscellaneous notes and documentation |
~rolesdb/extract | Empty |
~rolesdb/lib | A few generic perl modules, and some config files |
~rolesdb/log | Most recent log files from data feed programs |
~rolesdb/misc | Miscellaneous notes and working files |
~rolesdb/sap_feed | Obsolete versions of Roles->SAP data feed programs |
~rolesdb/sql | SQL source files for creating tables, views, and stored procedures. Files for creating tables (new_schema*.sql) are preserved for documentation purposes and should NOT be rerun -- tables should never be dropped and recreated since we do not want to lose the data. Files for creating stored procedures and views can be modified and rerun. |
~rolesdb/sql/frequently_run_scripts | Special SQL scripts that are run periodically, e.g., to analyze tables |
~rolesdb/sap_feed | Obsolete versions of Roles->SAP data feed programs |
~rolesdb/xsap_feed/bin | Programs for Roles->SAP data feed programs |
~rolesdb/xsap_feed/config | Config files for Roles->SAP data feed programs |
~rolesdb/xsap_feed/data | Nightly data for Roles->SAP data feed programs |
...