Serverless Data Pipelines - Part 1

Snowflake Serverless Data Pipelines will enable more price and performance optimization for loading data into Snowflake. In this Snowflake ProTalk, we discuss how to take advantage of these new abilities, do a deep dive into the improved features, and discuss the serverless automation pipeline from the file store to its graduation and curation. 

In this session you will learn:

  • SnowPipes and configuring event triggering for your cloud provider
  • Improvements in the Snowflake Streams, including the new streams on views
  • Understanding Snowflake's Change Data Tracking on tables
  • Differences between Streams and Table Change Data Tracking and determining which method to use
  • Serverless tasks configuration
  • Producing appropriate merges to ensure the proper updates and inserts
  • Changes in the solution architecture as a result of the new developments


Serverless Data Pipelines - Part 2

Continuing our coverage on Snowflake's Serverless Data Pipelines. This new feature will enable more price and performance optimization for loading data into Snowflake, but building serverless data pipelines is like a game of Tetris. 

In this ProTalk session, we build on what we discussed in Part 1. Here's what you will learn: 

  • The differences between Streams and Table Change Data Tracking
  • How to transform and merge RAW data into curated tables
  • How to orchestrate with Serverless Tasks