Aggregation metrics

Aggregation metrics let you pick an aggregate function to apply to a data asset, giving you flexibility to measure a wide variety of data quality events and trends. To create one, begin at Create a metric, and choose Aggregation at Step 1 (Metric Info).

Step 2 (Configure Metric)

After you finish Step 1 (Metric Info), Step 2 (Configure Metric) appears in the main form:

1500
  1. Under Select data asset, review the datasource, schema, table, and column.
    • If these are empty because you started from the Metrics List, you'll need to select values for them. Note that when you select a table, the settings under Configure metric inherit values from that table.
  2. Under Aggregation function, choose a function to apply to the column's values.
  3. Optionally, to create a WHERE clause select Add +. New fields appear under Where clause that you can use to specify the necessary condition. To delete a WHERE clause, use the waste bin icon beside it to the right.
1342
  1. Under Configure metric, review the inherited settings. To use your own values, select Override Settings to unlock the settings for editing. Note that if the table you chose has partitions, Lightup detects them and displays relevant settings for them at the bottom of the inheritable settings.

πŸ“˜

For help deciding what values to use, see the list of options under Manage Table Settings.

  1. Optionally, select a column to use for slices. This can significantly improve your metric's query performance. Use the gear icon to set how the slice affects the metric's query.
  2. If needed, set up seasonality.
  3. After you finish configuring your new metric, select Create at the top right corner to proceed to Step 3 (Preview).

Step 3 (Preview)

1600

πŸ“˜

Editing a metric

When you edit an existing metric:

  • You'll see an option to view the metric's recent query history as well as a preview.
  • The Create command changes to Save when you edit an existing metric
  1. Select View sample data to see a sample set of 100 rows from the data asset. When you're done, select Stop Viewing.
  2. Optionally, adjust the date range for the preview. If you adjust the range, you must pick a start date and an end date.
  3. Select Preview to generate a chart of the metric using the specified date range.

πŸ“˜

Cancel a preview

Some datasources let you cancel a preview, for example because you noticed that date range was wrong. If cancelling is supported, you'll see a Cancel button.

  1. After you're satisfied with the preview, select Create at the top right corner. The Explorer tab opens and displays your new metric in the Explorer tree.