SDF supports both static (compile time) and dynamic (run time) data quality tools out of the box.
There are many great existing data quality tools out there, primarily focused on runtime validations. There are tools for observability, expectation testing, and more.
SDF provides 4 concepts for data quality.
See the diagram below for the order of operations of data quality steps. It is recommended to run static data quality validations like compiling, checking, and reporting as part of CI/CD.
Learn about Checks, a completely new tool for Static Analysis powered data quality.
Learn about Reports, a powerful way to understand your data warehouse, from ingestion to consumption.
Learn about Tests, a familiar expectations-like framework for data quality. With a powerful builtin library, it’s easy to get started.
Learn about Stats, a fast & consistent way to get at-a-glance understanding of any specific dataset.