When you first open the Lightup app from Databricks Partner Connect, you'll see one workspace that contains one datasource.
- The workspace's name is your account's first name, an underscore, and then your Databricks Workspace ID. This workspace is selected when you first open Lightup, so its contents are displayed on the Explorer tab.
- A datasource named DatabricksPC is connected to the schemas you selected when you set up the trial on Databricks.
If other people in your organization have already begun using the Lightup trial, you may see additional workspaces listed in the left nav pane. If you can see a workspace then you can view its contents on the Explorer tab, but the actions you can take depend on your workspace role.
As a Databricks trial participant, you have the App Editor role, which grants you the ability to create workspaces, and the Workspace Admin role in the initial workspace, which grants full control inside the workspace.
For more information, see Working in workspaces.
You've got a datasource, but at first it looks empty. Before you start creating metrics, you need the data assets to be Active. Data assets exist in a hierarchy that reflects the data structures in your connected datasources; this hierarchy appears in the Explorer tree - the tab labeled Explorer in the main part of the page.
You can create metrics at three levels of the data hierarchy: schema, tables, and columns.
- In the Explorer tree, select the DatabricksPC datasource.
- On the right, on the Actions menu, select Manage metrics. A modal opens and displays the schema in your datasource, similar to the following image.
- In the modal, under Active, slide the toggle to the right to make the schema Active. It may take a few moments for Lightup to scan the schema.
- New toggles appear for any applicable schema autometrics. To enable an autometric, slide its toggle to the right.
After you make your schema Active, you'll see it under your datasource in the Explorer tree, where you can then make its tables active and enable table autometrics.
- Select your schema in the Explorer tree.
- On the Actions menu, select Manage metrics.
From here, your experience depends on what tables and columns you have, but the pattern is essentially the same: select a data asset in the Explorer tree, use Actions > Manage metrics to make any of its child data assets active and enable relevant autometrics, then repeat for each data asset you make Active.
To learn more about setting up data assets, go to Prepare tables for data quality monitoring. From there, follow the content to learn how to set up metrics, monitors, and other data quality monitoring features.
Updated 21 days ago