June 25th, 2024

We are excited to announce that a new major release of our CLI is now available, bringing improvements, new features, and bug fixes to SDF. Interested in our product roadmap or want to discuss features? Reach out to your SDF point of contact to provide any points of feedback!

Introducing SDF Labs Community Slack

Join our new community slack channel to keep up to date on all things SDF.

Migrating from v0.2.x to v0.3.x

With the introduction of major changes such as the information schema, providers expanding to integrations, and changes to the workspace.sdf.yml, previous workspaces will encounter breaking changes when upgraded. If you have not migrataed yet, please reference this guide: Migrating from v0.2.x to v0.3.x

Mom’s Flower Shop Walk Through

This tutorial series works through a single SDF workspace - “Mom’s Flower Shop”. In this page, we will provide a setup guide as well as an overview of this workspace. We will even use SDF to conduct some initial exploration.

SDF DB in Alpha

Local execution with support for trino / presto syntax is up and running. The functions powering this execution have been open sourced and can be found here

.sdfcache is now sdftarget

.sdfcache is now called sdftarget and is no longer hidden directory. Thanks for your feedback on this! Remember to update your .gitignore and not commit the old .sdfcache.

Trino Supported Functions

Overview of Trino functions execution were added. SDF DB is currently designed to model Trino in semantics and execution. All functions are currently designed for 1:1 compatiblity with the functions in the Trino Dialect. Each function has a new example and supported signature.

Easily Switch Between Local-External and Remote Sources

To easily switch between local-external and remote sources for your SDF workspace, the workspace.sdf.yml file will need to be set up with environment blocks. These environment blocks can be specified as dev and prod to be referenced by CLI commands such as sdf compile -e dev.

To learn more about setting up and managing environments, check out this doc about SDF workspaces for sandbox, dev, staging, and production.

New Documentation!

DBT Migration Guide - SDF is best used as an entire transformation layer in itself, effectively replacing DBT and adding all the benefits of SDF. Migrating from DBT to SDF is a straightforward process and involved two steps: Converting your DBT models to SDF models and mimicking DBT configuration in SDF. Follow the guide to

General bug fixes and stability improvements:

  • Fix relative bug issues and add tests
  • Support for Jinja Comments (including whn no further Jinja template is being used)
  • Renaming of sdfcache to sdftarget
  • Introduce new SDF Errors