Overview
SDF has the ability to connect with many databases, and supports numerous SQL dialects. Are you looking for an integration that’s not yet supported? Let us know by giving us feebdack here Use the below feature matrix to determine if SDF is right for youFeature Matrix
Database Support
SDF is working to build parity with common data warehouse development patterns including Jinja macro pre-processing, materialization strategies, multiple environment support, and more.When we say “SQL Dialect Support”, we mean support for SDF’s rich static analysis toolset - including compilation, lineage, dependency analysis, and more.
Authentication Support
SDF Supports authentication to one or more databases simultaneously through integrations & credentials. To check the current status of all credentials held by SDF, runsdf auth status.
Orchestration Support
SDF Supports simple orchestration. Commands likecompile & run are executed in dependency order, allowing for simple orchestration via cron jobs, or GitHub Actions.
For more advanced orchestration needs, SDF recommends Dagster.
Platforms
SDF is currently supported on the following platforms. The executable is small (<75mb), but heavily parallelized. As such, SDF’s resource consumption is dependent entirely on your data processing requirements.
For a complete list of releases, please see the official
GitHub releases page.