Snowflake

Datalogz natively supports Snowflake, which allows you to seamlessly integrate Snowflake with your Datalogz environment.

How does it work?

Datalogz uses sql_alchemy to extract column and table level metadata and last updated times from Snowflake. Option to configure table popularity and lineage also exists using Access_History tables.

What information is extracted?

Metadata

  1. Database

  2. Schema

  3. Table Name

  4. Table Description

  5. Column Name Column

  6. Ordinal Position

  7. Column Description

Access History

  1. Executed Queries

  2. User executing query

  3. Columns used in queries

Last Update Time

  1. Schema

  2. Table Name

  3. Last Update Time

How to Set up in Datalogz?

There are three steps to getting started using Snowflake with Datalogz. Make sure that you are running the commands in each step while logged in as an ACCOUNTADMIN, or an account that has MANAGE GRANTS.

  1. Create User for Datalogz (Optional)

  2. Connect Snowflake to Datalogz

  3. Whitelist IP Address

Create a User for Datalogz (Optional)

You need to create the user connected to Datalogz. Be sure to use a strong, unique password.

CREATE USER Datalogz_USER

MUST_CHANGE_PASSWORD = FALSE

DEFAULT_ROLE = SYSADMIN

PASSWORD = "my_strong_password";

GRANT ROLE SYSADMIN TO USER Datalogz_USER;

SYSADMIN role required to extract data lineage.

Connect Snowflake to Datalogz

User Name: Your accounts Snowflake user name or a Datalogz specific account user name

Password: Your accounts Snowflake password or a Datalogz specific account password

Account: Unique Identifier associated with your snowflake account

Role: Role within your Snowflake account (i.e ACCOUNTADMIN, SYSADMIN, PUBLIC)

Warehouse: Warehouse you'd like Datalogz to run extractor jobs on (i.e COMPUTE_WH)

DB Name: Database name that you'd like Datalogz to extract metadata from

Data Access Location: Link to your Snowflake URL to allow users direct access

Whitelist Datalogz IP Addresss

Depending on your IT setup, you may be required to whitelist Datalogz's IP address.

IP Address: 20.72.176.193

Follow these steps from Snowflake: https://docs.snowflake.com/en/user-guide/network-policies.html

PreviousBigQueryNextdbt

Last updated