V0.3.1
This document contains release notes from version 0.3.1 of SDF.
June 25th, 2024
We are excited to announce that a new major release of our CLI is now available, bringing improvements, new features, and bug fixes to SDF. Interested in our product roadmap or want to discuss features? Reach out to your SDF point of contact to provide any points of feedback!
Introducing SDF Labs Community Slack
Join our new community slack channel to keep up to date on all things SDF.
Migrating from v0.2.x to v0.3.x
With the introduction of major changes such as the information schema, providers expanding to integrations, and changes to the workspace.sdf.yml
,
previous workspaces will encounter breaking changes when upgraded. If you have not migrataed yet, please reference this guide: Migrating from v0.2.x to v0.3.x
Mom’s Flower Shop Walk Through
This tutorial series works through a single SDF workspace - “Mom’s Flower Shop”. In this page, we will provide a setup guide as well as an overview of this workspace. We will even use SDF to conduct some initial exploration.
SDF DB in Alpha
Local execution with support for trino / presto syntax is up and running. The functions powering this execution have been open sourced and can be found here
.sdfcache is now sdftarget
.sdfcache
is now called sdftarget
and is no longer hidden directory. Thanks for your feedback on this!
Remember to update your .gitignore
and not commit the old .sdfcache
.
Trino Supported Functions
Overview of Trino functions execution were added. SDF DB is currently designed to model Trino in semantics and execution. All functions are currently designed for 1:1 compatiblity with the functions in the Trino Dialect. Each function has a new example and supported signature.
Easily Switch Between Local-External and Remote Sources
To easily switch between local-external and remote sources for your SDF workspace,
the workspace.sdf.yml
file will need to be set up with environment blocks. These
environment blocks can be specified as dev
and prod
to be referenced by CLI commands
such as sdf compile -e dev
.
To learn more about setting up and managing environments, check out this doc about SDF workspaces for sandbox, dev, staging, and production.
New Documentation!
DBT Migration Guide - SDF is best used as an entire transformation layer in itself, effectively replacing DBT and adding all the benefits of SDF. Migrating from DBT to SDF is a straightforward process and involved two steps: Converting your DBT models to SDF models and mimicking DBT configuration in SDF. Follow the guide to
General bug fixes and stability improvements:
- Fix relative bug issues and add tests
- Support for Jinja Comments (including whn no further Jinja template is being used)
- Renaming of sdfcache to sdftarget
- Introduce new SDF Errors