1) What is Job Management System
2) What is a Job
3) Autosys Features
4) AutoSys for Unix/NT Environments
5) The AutoSys Architecture (in Details
6) Common Definitions like machines, instance, environment etc.
7) Autosys Directory Structure
8) How Autosys Connects to the Database
i) Sybase connectivity method.
ii) Oracle connectivity method.
9) Running Multiple Instances
10) Running Cross-Instance Job Dependencies
11)High-Availability Options (Dual ES & EP)
12) Commands
13) Event State Abbreviations
14)Autosys_Secure
15) System States
16) Alarms
17) Exit Codes
18)Different Job Types & How to Define Jobs
19) Calendars
20)Monitoring / Reporting (monbro)
21) Job information Language (JIL)
22) Load Balancing
23) Event Processor Log file sample
24) Remote agent Log file sample
25) Troubleshooting.

A reliable, easy to use system that enables the user to completely manage their entire Job Processing requirements.
It will help implement enterprise growth and change, not dictate the way the enterprise operates.
Unicenter AutoSys JM is an automated job control system for scheduling, monitoring, and reporting. These jobs can reside on any configured machine that is attached to a network. A job is any single command, executable, script, or Windows batch file. Each job definition contains a variety of qualifying attributes, including the conditions specifying when and where a job should be run.

You can use the following methods to create job definitions:
• Using the graphical user interface ( GUI).
• Using the Job Information Language ( JIL) through a command -line interface.

- GUI and Command Line Interfaces
- Graphical Calendar Facility
- Automated Restart and Recovery
- High Availability
- Fault-tolerance
- Load Balancing and Queue Management
- Framework Management Integration
- ERP Adapters Integration
- Multiple Time Zone Support
- Reporting Capabilities
- Choose the interface that fits your environment
- Mix and match across UNIX and NT platforms with complete interoperability.
- Supports Windows, Unix – Sun Solaris, Aix , Hp -Ux Redhat & Suse Linux


The main Unicenter AutoSys JM system components are as follows:
· Event Server (AutoSys database)
· Event Processor
· Remote Agent
In addition, Unicenter AutoSys JM provides utilities to help you define, run, and maintain instances and jobs. The included utilities are platform-specific; however, all platforms include the graphical user interface (GUI) and Job Information Language (JIL). Both the GUI and JIL enable you to define, manage, monitor, and report on jobs.
The event server, or database, is the data repository for all system information and events as well as all job, monitor, and report definitions. Event server refers to the database where all the information, events, and job definitions are stored. Occasionally, the database is called a data server, which actually describes a server instance. That is, it is either a UNIX or Windows NT process, and it is associated data space (or raw disk storage), which can include multiple databases or tablespaces. Note: The database refers to the specific server instance and the “autosys” database for that instance. Some utilities, such as isql (Sybase), lets you specify a particular server and database, and this guide will use the more precise terms of data server and database in those cases. You can configure Unicenter AutoSys JM to run using two databases, or dual-event servers. This feature provides complete redundancy. Therefore, if you lose one event server due to hardware, software, or network problems, operations can continue on the second event server without loss of information or functionality.
The event processor is the heart of Unicenter AutoSys JM; it interprets and processes all the events it reads from the database. Sometimes called the event_demon, the event processor is the program, running either as a UNIX process or as a Windows NT service, which actually runs Unicenter AutoSys JM. It schedules and starts jobs. After you start the event processor, the event processor continually scans the database for events to be processed. When the event processor finds one, it checks whether the event satisfies the starting conditions for any job in the database. Based on this information, the event processor first determines what actions to take, then instructs the appropriate remote agent process to perform the actions. These actions might be the starting or stopping of jobs, checking for resources, monitoring existing jobs, or initiating corrective procedures. You can set up a second event processor, called the shadow event processor. If the primary event processor fails for some reason, the shadow event processor will take over the responsibility of interpreting and  processing events.
=========================
Remote Agent
On a UNIX machine, the remote agent is a temporary process started by the event processor to perform a specific task on a remote, or client, machine. On a Windows NT machine, the remote agent is a Windows NT service running on a client machine that is directed by the event processor to perform specific tasks. The remote agent starts the command specified for a given job, sends running and completion information about a task to the event server, and then exits. If the remote agent is unable to transfer the information, it waits and tries again until it can successfully communicate with the database.

EXAMPLE Scenario in UNIX

Explanation
The following steps explain the interactions in the example scenario:
1. From the event server, the event processor reads a new event, which is a STARTJOB event with a start time condition that has been met. Then the event processor reads the appropriate job definition from the database and, based on that definition, determines what action to take. In the example, it runs the rm /tmp/mystuff/* command on WorkStation_2.

2. The event processor communicates with the remote agent on WorkStation_2. As soon as the remote agent receives the instructions from the event processor, the connection between the two processes is dropped. After the connection is dropped, the job will run to completion, even if the event processor stops running.

3. The remote agent performs resource checks, such as ensuring that the minimum specified number of processes are available, then “forks” a child process that will actually run the specified command.

4. The command completes and exits, and the remote agent captures the command’s exit code.

5. The remote agent communicates the event (exit code, status, and so forth) directly to the event server. If the database is unavailable for any reason, the remote agent will go into a wait and resend cycle until it can deliver the message. Only two processes need to be running—the event processor and the event server.

From a hardware perspective, the Unicenter AutoSys JM architecture is composed of the following two types of machines attached to a network:
· Server machine
The server is the machine on which the event processor or the event server (database) reside.
· Client machine
The client is the machine on which the remote agent software resides, and where jobs run. A remote agent must be installed on the machine with the event processor, and it can also be installed on separate physical client machines.
An instance is one licensed version of Unicenter AutoSys JM software running as a server with one or more clients, on a single machine or on multiple machines.
An instance is defined by the following:
- An instance ID, an uppercase three-alphanumeric identifier defined by the AUTOSERV environment variable.
- You set the instance ID during installation and cannot change it.
- The $AUTOUSER/config.$AUTOSERV configuration file.
- At least one event server.
- At least one event processor.
Access to Unicenter AutoSys JM software and the event server is controlled by environment variables and the configuration parameters, which must be set for the event processor and the remote agents to communicate and the commands to execute. The following figure shows the default directory structure for Unicenter AutoSys JM . This figure refers to the installation directory as AUTOTREE. When this default structure is used, all the prompts displayed by the install scripts will match exactly what you see on the screen. The autouser directory can be placed elsewhere. The new directories are pointed to by the environment variables AUTOSYS and AUTOUSER.

===================================

===================================
All information is kept in a relational database (RDBMS) called the event server, which is configured for Unicenter AutoSys JM. Access to Unicenter AutoSys JM requires a connection to this database. That is, you must connect to the database to add, modify, control, report on, or monitor jobs, and to change certain configuration settings.
The following figure shows the scenario for connecting to an ORACLE database.

===================================

===================================
You can run multiple instances of Unicenter AutoSys JM on the same network at the same time. Some of the reasons you may want to run multiple instances are listed following:
ü Your processing volume is large, and you want to distribute the load down to the departmental level.
ü You want each department in your company to be insulated from what happens in other departments.
ü You want to separate or test your development and production environments.

Each instance must have its own event processor specified in the configuration file and it must have its own instance-specific event servers  installed. Event processors from multiple instances can access the same client machines to start jobs. To enable this, you must install a remote agent on the client machine for each instance that will run jobs on that machine. The following figure shows two instances of Unicenter AutoSys JM, each with a single event server. Both instances can send jobs to the same client machine as long as both instances have a remote agent installed or configured on that client machine.

===================================

===================================
A job defined to run on one instance could have as a starting condition the successful completion of a job running on a different instance. The specification for such a job dependency may appear as the following:
condition: success(jobA) AND success(jobB^PRD)
In this example, the success (jobB^PRD) condition specifies the successful completion of a job named jobB running on a different instance specified with the three-alphanumeric ID of PRD. If the dependency specification does not include a caret (^) and a different instance ID, the current instance will be used by default. Each time cross-instance job dependency is encountered, Unicenter AutoSys JM sends an EXTERNAL_DEPENDENCY event from the requesting instance. If the target instance cannot be reached, Unicenter AutoSys JM issues an INSTANCE_UNAVAILABLE alarm.

=====================================================================

When you implement cross-instance job dependencies, event processors can do the following:
ü Run on different server machines or on the same server machine.
ü Access the same client machines to start jobs.
ü Send events to other instances.
Note: If the event server of a target instance is down, the event processor will try to resend events every five minutes until it can reach the other instance’s event server.
============================================

============================================
Unicenter AutoSys JM provides two high-availability options that lets Unicenter AutoSys JM keep processing even if an event server or event processor fails due to hardware or connection problems. These high-availability options are dual event servers and a shadow event processor.
You can install and configure the high-availability options at the same time you install, or you can modify an existing installation to add the high availability options.
============================================

============================================
One way that Unicenter AutoSys JM provides high-availability is by running two event servers. The two event servers contain identical information, including job definitions and events, because Unicenter AutoSys JM reads and writes to both servers simultaneously. Unicenter AutoSys JM also keeps both event servers synchronized and provides complete recovery when one server becomes unusable, disabled, or corrupted.
When processing events, the event processor reads from both event servers. If it detects an event on one server and not the other, it will copy the missing event to the other server. In this way, a temporary problem in getting events to one of the servers will not interrupt processing.

============================================
When running within dual-event server mode, and the event processor detects an unrecoverable condition on one of the event servers, it automatically rolls over to single server mode. A rollover results from one of the following conditions:
ü The connection to the database is lost, and after the configured number of reconnect attempts, the database remains unconnected.
ü The database has an unrecoverable error, for example, the database is corrupt or a media failure occurs.
============================================

============================================
Another way that Unicenter AutoSys JM provides high-availability is through running with a shadow event processor. The shadow event processor is designed to take over event processing in case there is a failure of the primary event processor.
The following figure illustrates a typical configuration running with primary and shadow event processors as well as dual-event servers. The shadow event processor and dual-event servers are independent features, but you can run them together.

============================================
The shadow event processor is normally in idle mode, listening for routine pings from the primary event processor, which indicate all is well. If the shadow event processor stops receiving this signal, it assumes the primary event processor has failed.
If the shadow event processor does not receive the signal, it checks the third machine (defined in the configuration file) for the .dibs file. If it cannot connect to the third machine, the shadow event processor shuts down. If it can connect and cannot locate the .dibs file, the shadow event processor creates the file, attempts to signal the primary event processor to stop, and takes over processing the events. If the file already exists, it shuts down.
Similarly, if the primary event processor cannot locate and signal the shadow event processor,the primary processor checks the third machine for the .dibs file and follows the same procedure as the shadow event processor.
The shadow event processor is designed primarily for the situation where the machine on which the primary event processor runs goes down, or the network on which this processor runs goes down. Particular care is given to ensuring that both event processors never take over at the same time. To achieve this, Unicenter AutoSys JM uses the third machine and the existence of the .dibs file to resolve contentions and to eliminate the case where one processor takes over because its own network is down.
The shadow event processor is not guaranteed to take over in 100% of the cases where it theoretically could. For example, in the case of network problems, Unicenter AutoSys JM may not be able to determine which event processor is the functional one. In this case, both processors will shut down.
============================================

============================================

=====================================================================

Function:
Removes old information from the database. archive_events will optionally copy the information to an archive directory before deletion.
Syntax :
archive_events {-n num_of_days | -j num_of_days | -l num_of_days} [-A] [-d directory_name] [-B batch_size] [-D data server:database | -D TNSname] [-t timeout_in_secs]
Note: –t is a UNIX command only.
Description:
archive_events removes data from various database tables that are older than the specified number of days. You use this command to prevent the database from becoming full. If the -A option is used; the data is archived before it is deleted. It is copied into a default directory unless you specify a different directory with -d option. The –n option removes events and any alarms associated with them from the event table. The -j option removes information from the job_runs table.
In Dual-Server mode, the data is archived from both servers at the same time. If information from these tables is not regularly purged from the database, the database can fill up rather quickly, stopping all processing. We highly recommend that you run archive_events during the database maintenance cycle.
=================================================

Function:
Adds, deletes, and prints custom calendar definitions.
Syntax:
autocal_asc
Description:
autocal_asc provides a text-based, command line mechanism for creating, deleting, and printing custom calendars, which can be used to specify the days on which to start jobs, or days on which a job should not be started, for example: holidays. Each calendar has a unique name and a list of days.
Once created, calendars can be referenced in a job definition. Use one of the following methods to apply a calendar:
1. In the Job Definition Date/Time Options dialog, enter a calendar name in the Run on Days in Calendar field or the Do NOT Run on Days in Calendar Exclude field.
2. With JIL, enter a calendar name in the run_calendar or exclude_calendar attribute.
Whenever a calendar is updated, Unicenter AutoSys JM refigures the starting times for all jobs, which use that calendar.
==================================================

Function:
Starts the Scheduler Console.
Syntax: autocons
Description:
The autocons command starts up the Operator Console in UNIX, or the Scheduler Console in Windows for monitoring AutoSys jobs in real-time. You can also start the Console by clicking Ops Console in the GUI Control Panel. The Consoles lets you specify job selection criteria, which can be dynamically changed, to control, which jobs you want to view. This criteria includes the current job state, the job name (with wildcarding), and the machine on which the job runs. You can select any job and view more detailed information about it, including its starting conditions, dependent jobs, and autorep reports.
The Operator Console and the Scheduler Console provides an Alarm Manager, which allows the monitoring of alarms as they are generated. In the Alarm Manager, you can do the following:
Ø Enter responses to alarms.
Ø Set the alarm’s state—either acknowledged or closed.
===================================================

Function:
Verifies that the various communication facilities are correctly configured and functioning.
Syntax:
autoping -m {machine|ALL} [-A] [-D]
Description:
autoping verifies that the server and client machines are properly configured and are communicating successfully. It also checks and verifies that the Remote Agent and the Remote Agent’s database connection are functioning correctly. If you are running Dual-Event Servers, it checks both database connections. If requested, it generates an alarm when problems are detected. Since these client/server communication facilities are critical to functioning, autoping provides valuable information for troubleshooting, and should always be used early in that process.

When autoping is executed, the server (the machine from which autoping is issued) establishes a connection with the client machine and waits for the Remote Agent to respond. If successful, the following message will be displayed on standard output at the server:
AutoPinging Machine [machine]
AutoPing WAS SUCCESSFUL!
If there is a problem with the configuration, a message indicating that the remote machine has not responded (or that there is a more serious problem, such as a socket read error) will be displayed. If the -D argument is used; autoping attempts to connect to the database and displays the resultant output to the screen. It includes the output in the alarm, if one was generated with the -A argument. If you are running Dual-Event Servers, both databases are checked. You can issue autoping from any machine on which the autoping executable resides. The target can be any Remote Agent machine.

Example
To check whether the machine “X” is properly configured, and that its Remote Agent can function properly,
enter: autoping -m X
If successful, the following will display:
AutoPinging Machine [X]
AutoPing WAS SUCCESSFUL!

To check all machines and verify their database access, enter:
autoping -m ALL -D
If successful, the following will display:
AutoPinging Machine [X] AND checking the Remote Agent’s DB Access.
AutoPing WAS SUCCESSFUL!
AutoPinging Machine [Y] AND checking the Remote Agent’s DB Access.
AutoPing WAS SUCCESSFUL!
=======================================================

Function Reports information about a job, jobs within boxes, machines, and machine status. Also reports information about job overrides and global variables.

Syntax:

autorep {-J job_name | -M machine_name | -G global_name} [-s | - w | -d | -q | -o over_num] [-R run_num][-L print_level] [-N Retry] [-t] [-D data_server:database | -D TNSname]

Description:

autorep lists a variety of information about jobs, machines, and global variables currently defined in the database. You can use it to list a summary of all currently defined jobs, or to display current machine load information. autorep serves as a problem tracking tool by listing all relevant event information for the last run of any given job, or a specified job run. You can also use it to extract job definitions in JIL script format and save them to an output file for later reloading into AutoSys, as a means of backing up job definitions.

autorep retrieves data from the database to formulate the reports. Any data that has been archived with archive_events will not appear in the reports. When listing nested jobs, subordinate jobs are indented to illustrate the hierarchy. The following sections describe the types of autorep reports.

The columns in an autorep report vary with the type of report requested. The following table describes the columns.

==============================================================

The following table lists the abbreviations used in the ST (status) column of the autorep report, and gives the status for each abbreviation.

===============================================================

The following table lists the abbreviations used in the ES (event state) column of the autorep report, and gives the status for each abbreviation.

The following summary report is for a run of the Nightly_Download example. This command requests the report:

autorep -J Nightly_Download

Job Name Last Start Last End ST RunPri/Xit

_______________ _____________________________________ _________

Nightly_Download 11/08/2009 17:00 11/08/2009 17:52 SU 101/1

Watch_4_file 11/08/2009 17:00 11/08/2009 17:13 SU 101/1

filter_data 11/08/2009 17:13 11/08/2009 17:24 SU 101/1

update_DBMS 11/08/2009 17:24 11/08/2009 17:52 SU 101/1

The following example lists all machines defined on the data server. This command requests the report:

autorep -M ALL

Machine Name Max Load Current Load Factor O/S

______________ ________ __________________ _____

london 100 0 1.00 Unix

berlin 90 0 0.90 NT

v_italy.rome 0 0 0.00 Unix

v_italy.venice 0 0 0.00 Unix

v_france.paris 100 0 1.00 NT

To list the value of all global variables that have been set, enter:

autorep -G ALL

The output from this command would look similar to the following:

Global Name Value Last Changed

———— ———— ——————-

AUDIT_DIR /usr/audit 11/12 /1997 12:41:00

You can use the autorep command to extract job definitions in JIL script format and direct the output to a file. The following example shows how to save all job definitions to a file.

autorep -J ALL -q > dump_file

The output of this command is formatted exactly as a JIL job definition script, like

the following:

insert_job: test_job

job_type: c

command: sleep 60

machine: juno

#owner: jerry@jupiter

permission: gx,ge,wx

alarm_if_fail: 1

======================================================================

Function: 

Displays the Event processor and Remote Agent log files.

Syntax: 

autosyslog [-e | -J job_name] [-p]

Description:

autosyslog is used to view either the event processor log file or the Remote Agent log file for the specified job. Both the Remote Agent and Event Processor write diagnostic messages to their respective logs, as part of their normal operations and in response to detected error conditions. autosyslog provides useful troubleshooting information because the event processor logs all events it processes and provides a detailed trace of its activities. If Unicenter AutoSys JM appears to be behaving abnormally, these logs are the first places you should look. Using autosyslog to view the event processor log is the same as issuing the following command:

tail -f $AUTOUSER/out/event_demon.$AUTOSERV

The last 10 lines of the event processor log file are displayed when the autosyslog command is issued. The log file is updated continually as processing occurs. To terminate the display of the log, press Ctrl+C in the display window. Remote Agent log The autosyslog utility can be a useful diagnostic tool when jobs fail. This command, when provided with the name of a job, displays the log of the job’s most recent run. Although the Remote Agent’s log file is automatically deleted by default after a successful job run, the log file will not be deleted at job completion if the job ended with a FAILURE status.

========================================================