community.aws.opensearch module – Creates OpenSearch or ElasticSearch domain

Note

This module is part of the community.aws collection (version 5.0.0).

To install it, use: ansible-galaxy collection install community.aws. You need further requirements to be able to use this module, see Requirements for details.

To use it in a playbook, specify: community.aws.opensearch.

New in community.aws 4.0.0

Synopsis

  • Creates or modify a Amazon OpenSearch Service domain.

Requirements

The below requirements are needed on the host that executes this module.

  • boto3 >= 1.18.0

  • botocore >= 1.21.0

  • botocore >= 1.21.38

  • python >= 3.6

Parameters

Parameter

Comments

access_policies

dictionary

IAM access policy as a JSON-formatted string.

advanced_security_options

dictionary

Specifies advanced security options.

enabled

boolean

True if advanced security is enabled.

You must enable node-to-node encryption to use advanced security options.

Choices:

  • false

  • true

internal_user_database_enabled

boolean

True if the internal user database is enabled.

Choices:

  • false

  • true

master_user_options

dictionary

Credentials for the master user, username and password, ARN, or both.

master_user_arn

string

ARN for the master user (if IAM is enabled).

master_user_name

string

The username of the master user, which is stored in the Amazon OpenSearch Service domain internal database.

master_user_password

string

The password of the master user, which is stored in the Amazon OpenSearch Service domain internal database.

saml_options

dictionary

The SAML application configuration for the domain.

enabled

boolean

True if SAML is enabled.

To use SAML authentication, you must enable fine-grained access control.

You can only enable SAML authentication for OpenSearch Dashboards on existing domains, not during the creation of new ones.

Domains only support one Dashboards authentication method at a time. If you have Amazon Cognito authentication for OpenSearch Dashboards enabled, you must disable it before you can enable SAML.

Choices:

  • false

  • true

idp

dictionary

The SAML Identity Provider’s information.

entity_id

string

The unique entity ID of the application in SAML identity provider.

metadata_content

string

The metadata of the SAML application in XML format.

master_backend_role

string

The backend role that the SAML master user is mapped to.

master_user_name

string

The SAML master username, which is stored in the Amazon OpenSearch Service domain internal database.

roles_key

string

Element of the SAML assertion to use for backend roles. Default is roles.

session_timeout_minutes

integer

The duration, in minutes, after which a user session becomes inactive. Acceptable values are between 1 and 1440, and the default value is 60.

subject_key

string

Element of the SAML assertion to use for username. Default is NameID.

allow_intermediate_upgrades

boolean

If true, allow OpenSearch domain to be upgraded through one or more intermediate versions.

If false, do not allow OpenSearch domain to be upgraded through intermediate versions. The upgrade operation fails if it’s not possible to ugrade to engine_version directly.

Choices:

  • false

  • true ← (default)

auto_tune_options

dictionary

Specifies Auto-Tune options.

desired_state

string

The Auto-Tune desired state. Valid values are ENABLED and DISABLED.

Choices:

  • “ENABLED”

  • “DISABLED”

maintenance_schedules

list / elements=dictionary

A list of maintenance schedules.

cron_expression_for_recurrence

string

A cron expression for a recurring maintenance schedule.

duration

dictionary

Specifies maintenance schedule duration, duration value and duration unit.

unit

string

The unit of a maintenance schedule duration. Valid value is HOURS.

Choices:

  • “HOURS”

value

integer

Integer to specify the value of a maintenance schedule duration.

start_at

string

The timestamp at which the Auto-Tune maintenance schedule starts.

aws_access_key

aliases: ec2_access_key, access_key

string

AWS access key. If not set then the value of the AWS_ACCESS_KEY_ID, AWS_ACCESS_KEY or EC2_ACCESS_KEY environment variable is used.

The aws_access_key and profile options are mutually exclusive.

aws_ca_bundle

path

The location of a CA Bundle to use when validating SSL certificates.

Note: The CA Bundle is read ‘module’ side and may need to be explicitly copied from the controller if not run locally.

aws_config

dictionary

A dictionary to modify the botocore configuration.

Parameters can be found at https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html#botocore.config.Config.

aws_secret_key

aliases: ec2_secret_key, secret_key

string

AWS secret key. If not set then the value of the AWS_SECRET_ACCESS_KEY, AWS_SECRET_KEY, or EC2_SECRET_KEY environment variable is used.

The aws_secret_key and profile options are mutually exclusive.

cluster_config

dictionary

Parameters for the cluster configuration of an OpenSearch Service domain.

availability_zone_count

integer

An integer value to indicate the number of availability zones for a domain when zone awareness is enabled. This should be equal to number of subnets if VPC endpoints is enabled.

cold_storage_options

dictionary

Specifies the ColdStorageOptions config for a Domain.

enabled

boolean

True to enable cold storage. Supported on Elasticsearch 7.9 or above.

Choices:

  • false

  • true

dedicated_master

boolean

A boolean value to indicate whether a dedicated master node is enabled.

Choices:

  • false

  • true

dedicated_master_instance_count

integer

Total number of dedicated master nodes, active and on standby, for the domain.

dedicated_master_instance_type

string

The instance type for a dedicated master node.

instance_count

integer

Number of instances for the domain.

instance_type

string

Type of the instances to use for the domain.

warm_count

integer

The number of UltraWarm nodes in the domain.

warm_enabled

boolean

True to enable UltraWarm storage.

Choices:

  • false

  • true

warm_type

string

The instance type for the OpenSearch domain’s warm nodes.

zone_awareness

boolean

A boolean value to indicate whether zone awareness is enabled.

Choices:

  • false

  • true

cognito_options

dictionary

Parameters to configure OpenSearch Service to use Amazon Cognito authentication for OpenSearch Dashboards.

enabled

boolean

The option to enable Cognito for OpenSearch Dashboards authentication.

Choices:

  • false

  • true

identity_pool_id

string

The Cognito identity pool ID for OpenSearch Dashboards authentication.

role_arn

string

The role ARN that provides OpenSearch permissions for accessing Cognito resources.

user_pool_id

string

The Cognito user pool ID for OpenSearch Dashboards authentication.

debug_botocore_endpoint_logs

boolean

Use a botocore.endpoint logger to parse the unique (rather than total) “resource:action” API calls made during a task, outputing the set to the resource_actions key in the task results. Use the aws_resource_action callback to output to total list made during a playbook. The ANSIBLE_DEBUG_BOTOCORE_LOGS environment variable may also be used.

Choices:

  • false ← (default)

  • true

domain_endpoint_options

dictionary

Options to specify configuration that will be applied to the domain endpoint.

custom_endpoint

string

The fully qualified domain for your custom endpoint.

custom_endpoint_certificate_arn

string

The ACM certificate ARN for your custom endpoint.

custom_endpoint_enabled

boolean

Whether to enable a custom endpoint for the domain.

Choices:

  • false

  • true

enforce_https

boolean

Whether only HTTPS endpoint should be enabled for the domain.

Choices:

  • false

  • true

tls_security_policy

string

Specify the TLS security policy to apply to the HTTPS endpoint of the domain.

domain_name

string / required

The name of the Amazon OpenSearch/ElasticSearch Service domain.

Domain names are unique across the domains owned by an account within an AWS region.

ebs_options

dictionary

Parameters to configure EBS-based storage for an OpenSearch Service domain.

ebs_enabled

boolean

Specifies whether EBS-based storage is enabled.

Choices:

  • false

  • true

iops

integer

The IOPD for a Provisioned IOPS EBS volume (SSD).

volume_size

integer

Integer to specify the size of an EBS volume.

volume_type

string

Specifies the volume type for EBS-based storage. “standard”|”gp2”|”io1”

encryption_at_rest_options

dictionary

Parameters to enable encryption at rest.

enabled

boolean

Should data be encrypted while at rest.

Choices:

  • false

  • true

kms_key_id

string

If encryption at rest enabled, this identifies the encryption key to use.

The value should be a KMS key ARN. It can also be the KMS key id.

endpoint_url

aliases: ec2_url, aws_endpoint_url, s3_url

string

URL to use to connect to EC2 or your Eucalyptus cloud (by default the module will use EC2 endpoints). Ignored for modules where region is required. Must be specified for all other modules if region is not used. If not set then the value of the EC2_URL environment variable, if any, is used.

engine_version

string

-> The engine version to use. For example, ‘ElasticSearch_7.10’ or ‘OpenSearch_1.1’. -> If the currently running version is not equal to engine_version, a cluster upgrade is triggered. -> It may not be possible to upgrade directly from the currently running version to engine_version. In that case, the upgrade is performed incrementally by upgrading to the highest compatible version, then repeat the operation until the cluster is running at the target version. -> The upgrade operation fails if there is no path from current version to engine_version. -> See OpenSearch documentation for upgrade compatibility.

node_to_node_encryption_options

dictionary

Node-to-node encryption options.

enabled

boolean

True to enable node-to-node encryption.

Choices:

  • false

  • true

profile

aliases: aws_profile

string

The profile option is mutually exclusive with the aws_access_key, aws_secret_key and security_token options.

purge_tags

boolean

If purge_tags=true and tags is set, existing tags will be purged from the resource to match exactly what is defined by tags parameter.

If the tags parameter is not set then tags will not be modified, even if purge_tags=True.

Tag keys beginning with aws: are reserved by Amazon and can not be modified. As such they will be ignored for the purposes of the purge_tags parameter. See the Amazon documentation for more information https://docs.aws.amazon.com/general/latest/gr/aws_tagging.html#tag-conventions.

Choices:

  • false

  • true ← (default)

region

aliases: aws_region, ec2_region

string

The AWS region to use. If not specified then the value of the AWS_REGION or EC2_REGION environment variable, if any, is used. See http://docs.aws.amazon.com/general/latest/gr/rande.html#ec2_region

security_token

aliases: aws_session_token, session_token, aws_security_token, access_token

string

AWS STS security token. If not set then the value of the AWS_SECURITY_TOKEN or EC2_SECURITY_TOKEN environment variable is used.

The security_token and profile options are mutually exclusive.

Aliases aws_session_token and session_token have been added in version 3.2.0.

snapshot_options

dictionary

Option to set time, in UTC format, of the daily automated snapshot.

automated_snapshot_start_hour

integer

Integer value from 0 to 23 specifying when the service takes a daily automated snapshot of the specified Elasticsearch domain.

state

string

Creates or modifies an existing OpenSearch domain.

Deletes an OpenSearch domain.

Choices:

  • “present” ← (default)

  • “absent”

tags

aliases: resource_tags

dictionary

A dictionary representing the tags to be applied to the resource.

If the tags parameter is not set then tags will not be modified.

validate_certs

boolean

When set to “no”, SSL certificates will not be validated for communication with the AWS APIs.

Choices:

  • false

  • true ← (default)

vpc_options

dictionary

Options to specify the subnets and security groups for a VPC endpoint.

security_groups

list / elements=string

Specifies the security group ids for VPC endpoint.

subnets

list / elements=string

Specifies the subnet ids for VPC endpoint.

wait

boolean

Whether or not to wait for completion of OpenSearch creation, modification or deletion.

Choices:

  • false ← (default)

  • true

wait_timeout

integer

how long before wait gives up, in seconds.

Default: 300

Notes

Note

  • If parameters are not set within the module, the following environment variables can be used in decreasing order of precedence AWS_URL or EC2_URL, AWS_PROFILE or AWS_DEFAULT_PROFILE, AWS_ACCESS_KEY_ID or AWS_ACCESS_KEY or EC2_ACCESS_KEY, AWS_SECRET_ACCESS_KEY or AWS_SECRET_KEY or EC2_SECRET_KEY, AWS_SECURITY_TOKEN or EC2_SECURITY_TOKEN, AWS_REGION or EC2_REGION, AWS_CA_BUNDLE

  • When no credentials are explicitly provided the AWS SDK (boto3) that Ansible uses will fall back to its configuration files (typically ~/.aws/credentials). See https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html for more information.

  • AWS_REGION or EC2_REGION can be typically be used to specify the AWS region, when required, but this can also be defined in the configuration files.

Examples

- name: Create OpenSearch domain for dev environment, no zone awareness, no dedicated masters
  community.aws.opensearch:
    domain_name: "dev-cluster"
    engine_version: Elasticsearch_1.1
    cluster_config:
      instance_type: "t2.small.search"
      instance_count: 2
      zone_awareness: false
      dedicated_master: false
    ebs_options:
      ebs_enabled: true
      volume_type: "gp2"
      volume_size: 10
    access_policies: "{{ lookup('file', 'policy.json') | from_json }}"

- name: Create OpenSearch domain with dedicated masters
  community.aws.opensearch:
    domain_name: "my-domain"
    engine_version: OpenSearch_1.1
    cluster_config:
      instance_type: "t2.small.search"
      instance_count: 12
      dedicated_master: true
      zone_awareness: true
      availability_zone_count: 2
      dedicated_master_instance_type: "t2.small.search"
      dedicated_master_instance_count: 3
      warm_enabled: true
      warm_type: "ultrawarm1.medium.search"
      warm_count: 1
      cold_storage_options:
        enabled: false
    ebs_options:
      ebs_enabled: true
      volume_type: "io1"
      volume_size: 10
      iops: 1000
    vpc_options:
      subnets:
        - "subnet-e537d64a"
        - "subnet-e537d64b"
      security_groups:
        - "sg-dd2f13cb"
        - "sg-dd2f13cc"
    snapshot_options:
      automated_snapshot_start_hour: 13
    access_policies: "{{ lookup('file', 'policy.json') | from_json }}"
    encryption_at_rest_options:
      enabled: false
    node_to_node_encryption_options:
      enabled: false
    auto_tune_options:
      enabled: true
      maintenance_schedules:
      - start_at: "2025-01-12"
        duration:
          value: 1
          unit: "HOURS"
        cron_expression_for_recurrence: "cron(0 12 * * ? *)"
      - start_at: "2032-01-12"
        duration:
          value: 2
          unit: "HOURS"
        cron_expression_for_recurrence: "cron(0 12 * * ? *)"
    tags:
      Environment: Development
      Application: Search
    wait: true

- name: Increase size of EBS volumes for existing cluster
  community.aws.opensearch:
    domain_name: "my-domain"
    ebs_options:
      volume_size: 5
    wait: true

- name: Increase instance count for existing cluster
  community.aws.opensearch:
    domain_name: "my-domain"
    cluster_config:
      instance_count: 40
    wait: true

Authors

  • Sebastien Rosset (@sebastien-rosset)