Creating and Managing Multiple Job Queues
This document explains how customers can create multiple job queues and run jobs in parallel without experiencing issues such as data collisions.
Understanding Queues.
Queues. Queues work in First-In-First-Out (FIFO) mode. When a job runs in the queue, the next jobs are queued and wait for their turn to run. To run two jobs in parallel, it is necessary to distribute them into different queues. Queues are grouped into Clusters. There is one cluster per Data Location, named after the data location. Jobs are themselves executed sequentially in defined Queues in a FIFO (First-In First-Out) mode.
If two jobs can run simultaneously, they should be in different queues. For example, if two jobs are processing records from unrelated entities in the same model, then these jobs can run simultaneously in different queues
Creating a New Job Within a New Queue.
To create a job:
Right-click the Jobs node and select Add Job…. The Create New Job wizard opens.
In the Create New Job wizard, check the Auto Fill option and then enter the following values:
Name: Internal name of the object.
Description: Optionally enter a description for the Job.
In the Queue Name: you can overwrite the Default queue name. Overwritten the Default queue name allows you to create a new job queue.
Click Next.
In the Tasks page, select the Available Entities you want to process in this job and click the Add >> button to add them to the Selected Entities.
Click Finish to close the wizard. The Job editor opens.
Related articles
Jobs Sequencing and Parallelism
Creating Integration Jobs
Understanding Jobs, Queues and Logs