Create DQ Model
Accuracy
- Select the source dataset and fields which will be used for comparision
- Select the target dataset and fields which will be used for comparision
- Mapping the target fields with source
- Set partition configuration for source dataset and target dataset
- Set basic configuration for your model (name, system, threshold, etc.)
Data Profiling
- Select the target dataset and fields which want to be checked
- Define your syntax check logic which will be applied on the selected fields
- Set partition configuration for target dataset
- Set basic configuration for your model(name, system, threshold, etc.)
Publish
- Set basic configuration for your model(name, system, threshold, etc.)
JSON/YAML measure
- Create measure directly from JSON/YAML