msk-kafka-cluster

clowdhaus/msk-kafka-cluster/aws

Terraform Module HCL AWS

Terraform module to create AWS MSK (Managed Streaming for Kafka) resources 🇺🇦

Install

module "msk-kafka-cluster" {

source = "clowdhaus/msk-kafka-cluster/aws"

version = "2.13.0"

}

⭐ Source on GitHub 📦 Registry page

README

AWS MSK Kafka Cluster Terraform module Terraform module which creates AWS MSK (Managed Streaming for Kafka) resources. ![SWUbanner](https://github.com/vshymanskyy/StandWithUkraine/blob/main/docs/README.md) Usage See examples directory for working examples to reference: ```hcl module "msk_kafka_cluster" { source = "terraform-aws-modules/msk-kafka-cluster/aws" name = local.name kafka_version = "3.5.1" number_of_broker_nodes = 3 enhanced_monitoring = "PER_TOPIC_PER_PARTITION" broker_node_client_subnets = ["subnet-12345678", "subnet-024681012", "subnet-87654321"] broker_node_storage_info = { ebs_storage_info = { volume_size = 100 } } broker_node_instance_type = "kafka.t3.small" broker_node_security_groups = ["sg-12345678"] encryption_in_transit_client_broker = "TLS" encryption_in_transit_in_cl

Inputs (50)

Name	Type	Description	Default
schemas	map(any)	A map schemas to be created within the schema registry	`{}`
s3_logs_prefix	string	Prefix to append to the folder name	`null`
scaling_max_capacity	number	Max storage capacity for Kafka broker autoscaling	`250`
connect_worker_config_description	string	A summary description of the worker configuration	`null`
broker_node_connectivity_info	any	Information about the cluster access configuration	`{}`
timeouts	map(string)	Create, update, and delete timeout configurations for the cluster	`{}`
create_scram_secret_association	bool	Determines whether to create SASL/SCRAM secret association	`false`
cloudwatch_log_group_retention_in_days	number	Specifies the number of days you want to retain log events in the log group	`0`
broker_node_storage_info	any	A block that contains information about storage volumes attached to MSK broker n	`{}`
firehose_logs_enabled	bool	Indicates whether you want to enable or disable streaming broker logs to Kinesis	`false`
name	string	Name of the MSK cluster	`"msk"`
s3_logs_bucket	string	Name of the S3 bucket to deliver logs to	`null`
configuration_name	string	Name of the configuration	`null`
create_cluster_policy	bool	Determines whether to create an MSK cluster policy	`false`
enable_storage_autoscaling	bool	Determines whether autoscaling is enabled for storage	`true`
encryption_in_transit_in_cluster	bool	Whether data communication among broker nodes is encrypted. Default value: `true	`null`
broker_node_az_distribution	string	The distribution of broker nodes across availability zones ([documentation](http	`null`
s3_logs_enabled	bool	Indicates whether you want to enable or disable streaming broker logs to S3	`false`
scram_secret_association_secret_arn_list	list(string)	List of AWS Secrets Manager secret ARNs to associate with SCRAM	`[]`
cloudwatch_log_group_kms_key_id	string	The ARN of the KMS Key to use when encrypting log data	`null`
… and 10 more inputs

Outputs (32)

bootstrap_brokers_sasl_iam — One or more DNS names (or IP addresses) and SASL IAM port pairs. This attribute will have a value if

bootstrap_brokers_public — Comma separated list of one or more hostname:port pairs of Kafka brokers suitable to bootstrap conne

scram_secret_association_id — Amazon Resource Name (ARN) of the MSK cluster

appautoscaling_policy_policy_type — The scaling policy's type

bootstrap_brokers_vpc_connectivity — Comma separated list of one or more hostname:port pairs of Kafka brokers suitable to bootstrap conne

zookeeper_connect_string_tls — A comma separated list of one or more hostname:port pairs to use to connect to the Apache Zookeeper

configuration_latest_revision — Latest revision of the configuration

log_group_arn — The Amazon Resource Name (ARN) specifying the log group

bootstrap_brokers_tls — One or more DNS names (or IP addresses) and TLS port pairs. This attribute will have a value if `enc

bootstrap_brokers_public_sasl_scram — One or more DNS names (or IP addresses) and SASL SCRAM port pairs

cluster_uuid — UUID of the MSK cluster, for use in IAM policies

appautoscaling_policy_arn — The ARN assigned by AWS to the scaling policy

bootstrap_brokers_sasl_scram — One or more DNS names (or IP addresses) and SASL SCRAM port pairs. This attribute will have a value

bootstrap_brokers_vpc_connectivity_tls — One or more DNS names (or IP addresses) and TLS port pairs for VPC connectivity

configuration_arn — Amazon Resource Name (ARN) of the configuration

schema_registries — A map of output attributes for the schema registries created

bootstrap_brokers_plaintext — Comma separated list of one or more hostname:port pairs of Kafka brokers suitable to bootstrap conne

bootstrap_brokers_vpc_connectivity_sasl_iam — One or more DNS names (or IP addresses) and SASL IAM port pairs for VPC connectivity

schemas — A map of output attributes for the schemas created

appautoscaling_policy_name — The scaling policy's name

arn — Amazon Resource Name (ARN) of the MSK cluster

bootstrap_brokers — Comma separated list of one or more hostname:port pairs of Kafka brokers suitable to bootstrap conne

cluster_name — Name of the MSK cluster

current_version — Current version of the MSK Cluster used for updates, e.g. `K13V1IB3VIYZZH`

zookeeper_connect_string — A comma separated list of one or more hostname:port pairs to use to connect to the Apache Zookeeper

vpc_connections — A map of output attributes for the VPC connections created

bootstrap_brokers_public_sasl_iam — One or more DNS names (or IP addresses) and SASL IAM port pairs

bootstrap_brokers_vpc_connectivity_sasl_scram — One or more DNS names (or IP addresses) and SASL SCRAM port pairs for VPC connectivity

bootstrap_brokers_public_tls — One or more DNS names (or IP addresses) and TLS port pairs

connect_custom_plugins — A map of output attributes for the connect custom plugins created

… and 2 more outputs

Resources (13)

aws_appautoscaling_policyaws_appautoscaling_targetaws_cloudwatch_log_groupaws_glue_registryaws_glue_schemaaws_msk_clusteraws_msk_cluster_policyaws_msk_configurationaws_msk_scram_secret_associationaws_msk_vpc_connectionaws_mskconnect_custom_pluginaws_mskconnect_worker_configurationrandom_id

Topics & Tags

terraform kafka aws terraform-module aws-msk

Details

FrameworkTerraform Module

LanguageHCL

Version2.13.0

Cloud AWS

★ Stars63

Forks74

Total downloads450.6k

Inputs50

Outputs32