After you have a workspace ready, you'll want at least one datasource. A datasource is a connection from inside a workspace to a supported database. The data assets in a datasource (schemas, tables, columns) are the subject of all data quality management actions and options for the source database, within the workspace.

• A datasource exists within a workspace. Add a datasource connection in each workspace where you need it.
• You must have the Workspace Admin role to create or edit a datasource.
• You'll need to connect to your datasource with credentials. Each datasource has its own steps to connect. See the connector subpage for details.

Connect a datasource

1. In the left pane, open a workspace menu and select Datasources.
2. In the main page select Create Datasource +.

3. Enter a Datasource Name, then select a Connector Type.
4. Provide connection information for the connector you chose. For details, see the Connector setting section of the connector subpage.
5. After entering the required settings and any optional settings that apply, below the Connector setting section select Test Connection.
6. After a successful connection test, select Save.
7. Your new datasource appears in the list of available datasources. By default, these are listed in alphabetical order, so you might have to scroll or change the sort order to see your new datasource.

Connector subpages

• Athena
• BigQuery
• Databricks
• Greenplum
• Hive
• Incorta
• Microsoft SQL
• Oracle
• Postgres
• Redshift
• Snowflake
• Teradata

Set query governance settings for a datasource

1. On your workspace menu, select Query Governance.
2. In the main page, under Datasources choose a datasource to govern.
3. Set the query governance settings:
   • Scheduling - If Scheduling is on, the datasource can be made available and unavailable to metrics by using user-created schedules. Some datasources support always allowing interactive queries (i.e., ignoring schedules when previewing a metric or retrieving sample data)— if so, you'll see a toggle, Always allow interactive queries.
     If you use Schedules to control when a datasource's metrics can run, be sure to allow enough time for the metric queries to complete. Otherwise, if there are metric queries that haven't run when a datasource's schedule ends, the pending queries will not run.
   • Query timeout - If Query timeout is on, any Lightup query (the basis of metrics) that hasn't returned a value within the interval specified by Terminate after (number with time unit) stops running (fails).
   • Query date range limit- If Query date range limit is on, any Lightup query (the basis of metrics) that attempts to summarize data over a period that's longer that what's specified by Limit range to (number with time unit) is terminated (canceled).
   • Enforce sort-keyed timestamps - If enabled, you can't configure metrics unless the data asset's timestamp column is indexed.
   • Enable data storage - If enabled, record data that produced incidents can be stored.
   • Maximum backfill duration - Use to set a maximum backfill duration that's shorter than the system limit of 11,000 data points. For more information about the effect of this setting, see Backfill duration.

Scan a datasource for changes

Lightup regularly scans datasources for changes, but you can also initiate a scan manually.

1. With the datasource selected in Explorer, select Actions > Manage Schemas.
2. Near the top-right of the modal, select Run Manual Scan.
3. The scan is queued to run as soon as possible. To stop a running scan, select Cancel Scan.