snowpipe

Snowpipe This repository houses a Terraform module for creating automatically-ingesting Snowflake pipes from S3. In particular_, it implements Option 2 of the _Automating Snowpipe for Amazon S3_ Snowflake documentation, creating an SNS topic for each prefix Important Notes and Requirements The following points were hard-won lessons for us, and important to understand for working with this module. Nota bene. - Each S3 bucket can only have a single notification configuration. Look, it's right here in the docs! If you have an existing notification configuration for this bucket, this process will work, but it'll wipe out everything that already exists and you'll probably upset someone, possibly your future self. - There is a 72 hour lag between the deletion of an SNS topic subscription and bei