Configure a Data Source Aggregate job

Create a Data Source Aggregate job

A Data Source Aggregate job is a way to bring in data from multiple jobs at the same time. Each of these existing jobs must be from a similar data source, and the fields and attributes that are to be aggregated together must be the same.

To create a new Data Source Aggregate job:

  1. From within Data Manager, select Adapters in the left menu bar. This will open a new tab to the Adapters screen.

  2. Select Create a job in the left menu bar.

  3. Under General, select Data Source Aggregate.

Once you have created a new job, you must complete all of the Required (*) fields before the job can be successfully saved.

Configure a Data Source Aggregate job

In the Data Source Aggregate Configuration screen, configure details about the data source:

  1. In the Name field, enter a name for your job. This name will be used to identify your job when you run the Adapters client.

  2. Ensure the Enabled toggle is set to Enabled (dark blue). Disabled jobs cannot be run.

  3. If you want this data source to be available to Map, Cleanse, and Import after the job is run for the first time, ensure the Add as a data source toggle is set to Enabled (dark blue).

  4. In the Object Class field, select the Object Class destination for this data. Object Classes currently available in Data Manager.

  5. In the Data Source Type field, select an existing Data source type or create a new data source type, below.

For a Data Source Aggregate job to function effectively:

  • Ensure that the jobs added to a Data Source Aggregate share identical fields and attributes.

  • For each source job, set Add as a data source to Disabled to prevent the creation of individual data sources.

  • For the Data Source Aggregate job itself, set Add as a data source to Enabled to ensure that the aggregated job generates a single data source containing the combined data.

What type of data is Data Manager providing? This is usually the name of the tool (e.g. SCCM, Intune, JSMAssets, Qualys) or the discipline (e.g. Asset, CMDB).

5. In the Data Source Name field, enter a name for the Data Source that will be created when this job is run.

The type of data being created; which is usually the tool name, e.g AD, Qualys or Aggregate<data source name> in this case. This can be the same as Name, above.

6. In the Jobs section, first use the dropdown to select each of the jobs you wish to add, and then select Add Job to add the job to the list of jobs in the Data Source Aggregate.

  • Ensure that the jobs added to a Data Source Aggregate share identical fields and attributes.

  • For each source job, configure Add as a data source to Disabled to prevent the creation of individual data sources.

  • For the Data Source Aggregate job itself, set Add as a data source to Enabled to ensure that the aggregated job generates a single data source containing the combined data.

Save a Data Source Aggregate job

Once all required fields have been filled and all columns in the data source have been mapped, you can Save this job. Your new job should be visible in the All Jobs screen.

Still need help?

The Atlassian Community is here for you.