SnowFlake Career Transition Program

Course Curriculum

Introduction to Snowflake

What Is Data Warehouse?
Important Data Warehouse Concepts
Difference between OLAP vs OLTP
Data Ecosystem Mindmap
What is Snowflake? Why Snowflake?
Snowflake Architecture
Snowflake Object Hierarchy
Setting Up Snowflake Account
Snowflake Virtual Warehouse
Snowflake Billing & Resource Monitor

Tables in Snowflake

Partitioning, Clustering and Performance Optimisation in Snowflake

Data Loading/Ingestion and Extraction

What is Data Ingestion?
Data Ingestion in Real-World
Create an Integration Object to Connect Snowflake with AWS S3
Ingesting CSV from S3 to Snowflake
Ingest JSON from S3 to Snowflake
How to do Continuous Data Ingestion in Snowflake
SnowPipe: Implementation of Snow Pipe
SnowPipe: Billing Estimation and Key Considerations for Data Ingestion
Unloading of Data from Snowflake to S3

Tasks and Query Scheduling

Streams and Change Data Capture

User-Defined Functions in Snowflake

Snowflake – External Functions

Snowflake with Python, Spark, and Airflow on AWS

Connect Python with Snowflake in Your Local Machine
Introduction to AWS Glue
Deploy and Execute Python Script to AWS Glue
Parameterize Your Python Script on AWS Glue
Python Pandas with Snowflake on AWS Glue
What Is Pushdown in Spark 3.1?
What is Spark? Introduction to PySpark
Deploy a PySpark Script Using AWS Glue
What is Airflow?
Set Up Managed Airflow Cluster on AWS
Configure Snowflake Connectivity in Airflow
Deploy a PySpark Transformation job in AWS Glue
Set Up Airflow DAG

Real-Time Streaming with Kafka and Snowflake

Snowflake – Data Protection and Governance

Project Work

Level

Intermediate
Last Updated

May 12, 2023
Certificate

Certificate of completion

A course by

kanth@bepec.in

SnowFlake Career Transition Program

Course Curriculum

Introduction to Snowflake

What Is Data Warehouse?

Important Data Warehouse Concepts

Difference between OLAP vs OLTP

Data Ecosystem Mindmap

What is Snowflake? Why Snowflake?

Snowflake Architecture

Snowflake Object Hierarchy

Setting Up Snowflake Account

Snowflake Virtual Warehouse

Snowflake Billing & Resource Monitor

Tables in Snowflake

Different Types of Tables in Snowflake

Creating Tables in Snowflake

Materialised Views, Views & Secure Views in Snowflake

Creating Views in Snowflake

Creating Secure Views in Snowflake

In-depth about Views in Snowflake

Partitioning, Clustering and Performance Optimisation in Snowflake

Introduction to Partitions & Clustering Keys

Creating Micro-Partitions and Clustering Keys

Why to go with Micro-Partitions and Clustering

Understanding Clustering Depth and Cluster Overlap

Selecting Clustering Keys

Checking Query Profile and History

Query Processing and Caching

Search Optimization Feature

Data Loading/Ingestion and Extraction

What is Data Ingestion?

Data Ingestion in Real-World

Create an Integration Object to Connect Snowflake with AWS S3

Ingesting CSV from S3 to Snowflake

Ingest JSON from S3 to Snowflake

How to do Continuous Data Ingestion in Snowflake

SnowPipe: Implementation of Snow Pipe

SnowPipe: Billing Estimation and Key Considerations for Data Ingestion

Unloading of Data from Snowflake to S3

Tasks and Query Scheduling

Introduction to Tasks

Creating Standalone and Dependent Tree of Tasks

Billing and Query History for Tasks

Streams and Change Data Capture

Introduction to Streams

Implementation of Standard Streams

Implementation of Append-Only Streams

Streams in a Transaction

Data Retention and Staleness

Change Tracking Using ” Changes “

End-to-End Stream Creation

End-to-End Pipeline Demonstration

User-Defined Functions in Snowflake

Introduction to User-Defined Functions and UDF Types

Write and Implement a Scalar UDF

Write Tabular UDF in SQL

Implement JavaScript UDFs

What Is Pushdown in UDF?

How Can Pushdown Expose the Underlying Data?

Implementing Secure UDFs

Snowflake – External Functions

Introduction to External Functions

What is AWS Lambda Functions?

Write & Deploy AWS Lambda Function

What is IAM Role in AWS?

Creating IAM Role in AWS

Create API Gateway

Secure and Deploy API Gateway

Create External Function in Snowflake

Snowflake with Python, Spark, and Airflow on AWS

Connect Python with Snowflake in Your Local Machine

Introduction to AWS Glue

Deploy and Execute Python Script to AWS Glue

Parameterize Your Python Script on AWS Glue

Python Pandas with Snowflake on AWS Glue

What Is Pushdown in Spark 3.1?

What is Spark? Introduction to PySpark

Deploy a PySpark Script Using AWS Glue

What is Airflow?

Set Up Managed Airflow Cluster on AWS