Data Portfolio
Users can reach all cataloged assets as a list by clicking the Assets from Explore on the menu.
Assets¶
In the Assets list, all data sources, catalogs, schemas and tables are comprehensively displayed.
- By clicking on the Only the newest catalogs, users can access the newest ones.
- By clicking on the arrow to the left of any data source, users can access the catalogs it contains.
- By clicking on the arrow to the left of any catalog, users can access the schemas it contains.
- By clicking on the arrow to the left of any schema, users can access the tables it contains.
Data Sources¶
icon indicates Data Source. Data Source details include Overview, Properties, Related, Comparison, Transfer and Profiled tabs.
- Refresh: It is used to refresh the field.
- Delete: It is used to delete the selected asset.
- + Add Profile: It is used to add a profile to the selected asset. Enter the display name, scheduler, number of retries and filter patterns, then click Save.
Overview Tab¶
It shows the general information about the data source as Description, Fully Qualified Name, Created Time, Domain, Owner, Terms, Classifications, Labels, Group, and Custom Attribute.
Properties Tab¶
It shows the property and its value.
Related Tab¶
It shows the related catalogs, schemas and tables.
Comparison Tab¶
It is used for comparisons. Select the catalog to compare and the reference catalog, then click the Compare button.
Transfer Tab¶
It is used to transfer a catalog. Select the catalog to transfer and the relevant metadata, then click the Transfer button.
Profiled Tab¶
Profiled results are displayed in this tab, including Name, Schedule, and Recent Runs details. Edit, Delete, and Run actions can be performed from the Action section.
Catalog¶
icon indicates Catalogs. Catalog details include Overview, Properties and Related tabs.
Overview Tab¶
It shows the general information about the catalog as Description, Fully Qualified Name, Created Time, Owner, Terms, Classifications, Labels, and Group.
Properties Tab¶
It shows the property and its value.
Related Tab¶
It shows the related data sources, schemas and tables.
Schema¶
icon indicates Schemas. Schema details include Overview, Properties and Related tabs.
Overview Tab¶
It shows the general information about the schema as Description, Fully Qualified Name, Created Time, Domain, Owner, Terms, Classifications, Labels, Group, and Custom Attribute.
Properties Tab¶
It shows the property and its value.
Related Tab¶
It shows the related data sources, catalogs and tables.
Table¶
icon indicates Tables. Table details include Overview, Properties, Columns, Data Quality & Profile and Related tabs.
- Refresh: It is used to refresh the field.
- Delete: It is used to delete the selected table.
For details about the available test table and column cases, go to Data Quality.
- + Add Test Table: It is used to add a test table to the selected asset. Enter the name, test type, and description then click Save.
- + Add Test Column: It is used to add a test column to the selected asset. Enter the column, name, test type, and description, then click Save.
- + Add Profile to Data Source: It is used to add a profile to the datasource. Enter the display name,scheduler, and filter patterns, then click Save.
Overview Tab¶
It shows the general information about the table as Description, Fully Qualified Name, Created Time, Domain, Owner, Terms, Classifications, Labels, Group, and Custom Attribute.
Properties Tab¶
It shows the property and its value.
Columns Tab¶
It shows the related columns with their classifications and terms.
Data Quality & Profile Tab¶
It is used to manage the data quality and profiling. It includes Table Profile, Column Profile, Test Cases, anad Test Suite Scheduler tabs.
- Table Profile tab displays the row count based on the selected date. The date can be selected from the top right corner.
- Column Profile tab presents the column profile details, including data type, value count, number of tests, status, and percentages of null, unique and distinct values.
Column Profile Details¶
To view more detailed analyses, click on the column name in the Column Profile tab.
Data aggregate chart shows how the sum change over time.
The Data Counts chart displays the number of distinct, null, unique, and values over time, helping to visualize the distribution and frequency of different data types.
The Data Distribution chart shows the frequency of data values along with their count.
The Data Proportions chart displays the proportions of distinct, null, and unique values over time, providing insights into the distribution and completeness of the data.
The Data Quartiles chart shows the distribution of data over time, including the first quartile, median, interquartile range, and third quartile, helping to understand the spread and central tendency of the data.
The Data Range chart displays the maximum, mean, and minimum values over time, providing insights into the range and central tendency of the data.
- Test Cases tab lists test cases along with name, column and last run details.
- Existing cases can be edited or deleted from the Actions section.
- Test Suite Scheduler tab lists test suites along with name, schedule, recent run status, work status, and last runtime details.
- Existing suites can be run, edited, or deleted from the Actions section.
- The toggle in the Work Status column allows switching the status between active and inactive.
- + Add Test Suite: It is used to add a test suite scheduler. Enter the name, choose the scheduler option, and select test cases, then click Save.
Related Tab¶
It shows the related data sources, catalogs and tables.
Comparison¶
This section provides information on changes between catalogs selected under the same data source. The reports include changes in columns, tables, and schemas, as well as additions and deletions, ownership updates, label modifications, classification changes, and more.
- Results can be exported as a CSV file using the Export as CSV button.
