Manage datasources

Set up accounts and connections

After you have a workspace ready, you'll want at least one datasource. A datasource is a connection from inside a workspace to a supported database. The data assets in a datasource (schemas, tables, columns) are the subject of all data quality management actions and options for the source database, within the workspace.

❗️

  • The procedures on this page require a Workspace Admin role.
  • A datasource is only available in the workspace where it was created.

To monitor your data quality, you connect to each database you want to monitor. To make that possible, you'll need a Lightup user account for each of them. Some datasources use existing database connection APIs (such as ODBC/JDBC), and others have proprietary APIs. The steps to connect to a database vary by platform.

📘

A datasource typically requires an account for Lightup in the target data asset (such as a database). Lightup supports numerous data platforms. Find steps on the corresponding subpage to prepare the lightup_user account before you connect to the datasource.

Connect a datasource

  1. In the left pane, open a workspace menu and select Datasources.
  2. In the main page select +.
11621162
  1. Enter a Datasource Name, then select a Connector Type.
  2. Provide connection information for the connector you chose. For details, see the Connector settings section of the corresponding subpage.
  3. After entering the required settings and any optional settings that apply, below the Connector Setting section select Test Connection.
  4. After a successful connection test, select Save.
  5. Your new datasource appears in the list of available datasources. By default, these are listed in alphabetical order, so you might have to scroll or change the sort order to see your new datasource.

Connector subpages

Set query governance settings for a datasource

📘

Not all query governance features are available for every data source connector. You might not see the feature, or it might appear but not be active. We're enabling query governance for more connectors. Look to the connector subpages for current information about query governance.

800800
  1. On your workspace menu, select Query Governance.
  2. In the main page, under Datasources choose a datasource to govern.
  3. Set the query governance settings:
    • Query timeout - use the toggle to turn this governor on and off. If Query timeout is on, any Lightup query (the basis of metrics) that hasn't returned a value within the interval specified by Terminate after (number with time unit) stops running (fails).
    • Query date range limit- use the toggle to turn this governor on and off. If Query date range limit is on, any Lightup query (the basis of metrics) that attempts to summarize data over a period that's longer that what's specified by Limit range to (number with time unit) is terminated (canceled).

Review query history

The Query History view shows totals for: queries Completed, Failed, Cancelled, and Processing. This information helps you decide when to turn on/off query governors on active datasources. For example, if a lot of Lightup queries are failing, Query timeout might be set too low.​

740740

Did this page help you?