) How do I load my data into Snowflake?
Limited data (Web Interface)
Bulk Data (SQL & SnowSQL)
Auto-INGEST(Snowpipe)
3rd Part ETL Tool
2) What types of data storage can Snowflake load from?
Supported file
(1) Structured Data
CSV
(1) Semi-Structured Data
JSON
Avro
Parquet
Orc
XML
3) What is a “stage” in Snowflake?
There are two type of stage (1) Internal (2) External
Internal Stage area (local system)
(a) User Stage > Each user has a Snowflake stage allocated to them by default for storing files. This stage is a convenient option if your files will only be accessed by a single user, but need to be copied into multiple tables.
Referenced:@~, Provided by default,Only access by user, Can't be alter or delete
(b) Table Stage > Each table has a Snowflake stage allocated to it by default for storing files. This stage is a convenient option if your files need to be accessible to multiple users and only need to be copied into a single table.
(c) Name Stage > database object, the security/access rules that apply to all objects apply. The privileges to use a stage can be granted or revoked from roles. In addition, ownership of the stage can be transferred to another role.
CREATE OR REPLACE STAGE my_stage
file_format = (type = 'CSV' FIELD_DELIMITER = '|' SKIP_HEADER = 1);
Create File Format
CREATE FILE FORMAT NAME
TYPE = CSV
File Type Modifiers
FIELD_DELIMITER ='|'
SKIP_HEADER =2;
COPY INTO table_name
FROM stage_name
[FILES = ('<file_name>'[,'<file_name>'...])]
FILE_FORMAT = (FORMAT_NAME = <file_format_name>)
External Stage (On Premise Storage)
(a) AWS,GCP,AZURE
Url access credentials
4) Why would I choose one loading method over another?
5) What are some best practices for data loading?