dataflow_pubsub_to_bq

AckeeCZ/dataflow_pubsub_to_bq/gcp

Terraform Module HCL GCP

Dataflow job subscriber to PubSub subscription. It takes message from subscription and push it into BigQuery table.

Install

module "dataflow_pubsub_to_bq" {

source = "AckeeCZ/dataflow_pubsub_to_bq/gcp"

version = "1.0.0"

}

plain text: /constructs/tfmod-ackeecz-dataflow-pubsub-to-bq-gcp/install.txt

⭐ Source on GitHub 📦 Registry page

README

Dataflow PubSub to BigQuery Dataflow job subscriber to PubSub subscription. It takes message from subscription and push it into BigQuery table. Before you do anything in this module Install pre-commit hooks by running following commands: ``shell script brew install pre-commit terraform-docs pre-commit install ` Requirements | Name | Version | |------|---------| | terraform | >= 0.13 | Providers | Name | Version | |------|---------| | google | n/a | | google-beta | n/a | | random | n/a | Modules No modules. Resources | Name | Type | |------|------| | google-beta_google_dataflow_flex_template_job.pubsub_to_bq_job | resource | | google_storage_bucket.provisioning_bucket | resource | | google_storage_bucket_object.pubsub_subscription_to_bq | resource | | random_string.random | resource | Input

Inputs (4)

Name	Type	Description	Default
bigquery_table	string	table_id of target table	required
bigquery_schema	string	Schema of target bigquery table	required
region	string	Region to deploy dataflow job to	required
input_subscription	string	Name of input subscription	required