kinesis-stream-es

DNXLabs/kinesis-stream-es/aws

Terraform Module HCL AWS

This terraform module can load streaming data into your Amazon Elasticsearch Service domain from Amazon Kinesis Data Firehose and Amazon CloudWatch Logs.

Install
module "kinesis-stream-es" {
source = "DNXLabs/kinesis-stream-es/aws"
version = "0.4.3"
}
plain text: /constructs/tfmod-dnxlabs-kinesis-stream-es-aws/install.txt
⭐ Source on GitHub 📦 Registry page
README

terraform-aws-kinesis-stream-es ![Lint Status](https://github.com/DNXLabs/terraform-aws-kinesis-stream-es/actions) ![LICENSE](https://github.com/DNXLabs/terraform-aws-kinesis-stream-es/blob/master/LICENSE) This terraform module can load streaming data into your Amazon Elasticsearch Service domain from Amazon Kinesis Data Firehose and Amazon CloudWatch Logs. You have the option to: - Create or not a elastisearch domain. If true, will create aws elasticsearch domain. - Encrypt at rest options. Only available for certain instance types. - Set the Number of instances in the cluster. - The default value is 3 - Set the Instance type of data nodes in the cluster. - The default value is "r5.large.elasticsearch" - Set the Number of Availability Zones for the domain to use with zone_awareness_enable

Inputs (22)
NameTypeDescriptionDefault
elasticsearch_namestringThe name of the Elasticsearch domain. required
private_subnet_idslist required
vpc_idstring required
elasticsearch_instance_typestring(Optional) Instance type of data nodes in the cluster."r5.large.elasticsearch"
firehose_lambda_processor_namestring"firehose_lambda_processor"
kinesis_firehose_namestring(Required) A name to identify the stream. This is unique to the AWS account and "kinesis-firehose-es-stream"
kinesis_firehose_index_rotation_periodstring(Optional) The Elasticsearch index rotation period. Index rotation appends a tim"OneDay"
elasticsearch_dedicated_master_enabledbool(Optional) Indicates whether dedicated master nodes are enabled for the cluster.false
elasticsearch_dedicated_master_countnumber(Optional) Number of dedicated master nodes in the cluster.3
elasticsearch_volume_sizenumberThe size of EBS volumes attached to data nodes (in GB). Required if ebs_enabled 10
elasticsearch_instance_countnumber(Optional) Number of instances in the cluster.3
elasticsearch_dedicated_master_typestring(Optional) Instance type of the dedicated master nodes in the cluster."m4.large.elasticsearch"
elasticsearch_availability_zone_countnumber(Optional) Number of Availability Zones for the domain to use with zone_awarenes2
kinesis_firehose_enabledboolIf true, will create the AWS kinesis firehose.true
kinesis_firehose_index_namestring(Required) The Elasticsearch index name."kinesis"
elasticsearch_versionstring(Optional) The version of Elasticsearch to deploy. Defaults to 7.4"7.4"
elasticsearch_zone_awareness_enabledbool(Optional) Indicates whether zone awareness is enabled, set to true for multi-azfalse
elasticsearch_encrypt_at_restbool(Optional) Encrypt at rest options. Only available for certain instance types.true
elasticsearch_node_to_node_encryptionbool(Optional) Node-to-node encryption options.true
elasticsearch_volume_typestring(Optional) The type of EBS volumes attached to data nodes."gp2"
kinesis_stream_bucket_namestringThe name of the S3 bucket to store failed documents."kinesis-logs-stream-backup-bucket"
elasticsearch_enabledboolIf true, will create aws elasticsearch domain.true
Outputs (1)
kinesis_arn — The ARN of the kinesis firehose stream to be used in the cloudwatch log subscription filter.
Resources (14)
aws_cloudformation_stackaws_cloudwatch_log_groupaws_cloudwatch_log_streamaws_elasticsearch_domainaws_iam_policyaws_iam_roleaws_iam_role_policyaws_iam_role_policy_attachmentaws_iam_service_linked_roleaws_lambda_functionaws_s3_bucketaws_security_groupaws_security_group_rulenull_resource
Details
FrameworkTerraform Module
LanguageHCL
Version0.4.3
Cloud AWS
★ Stars3
Forks4
Total downloads6.0k
Inputs22
Outputs1
Resources14
LicenseApache-2.0
NamespaceDNXLabs
Updated