Create Lambda Functions

Download the source code below:

  • load_stream_data.zip (578 ko)
  • search_docs.zip (578 ko)

    1. Open AWS Lambda console

    2. Click Create function

    CreateSQS

    1. Enter function name: search_docs
    • Selecting Runtime is Python 3.9
    • Click Create function

    CreateSQS

    1. Click Upload from, then select .zip file

    CreateSQS

    1. Click Upload and choose search_docs.zip file you just downloaded. Next click Save.

    CreateSQS

    1. Scroll down to bottom, in Runtime settings section, click Edit

    CreateSQS

    1. Repalce lambda_function with search_docs, then click Save

    CreateSQS

    1. Next, we will update the permissions for Lambda to be able to access the OpenSearch domain.
    • Select Configuration tab and select Permission on the left menu.
    • Select the execution role of this function

    CreateSQS

    1. Expand policy and click Edit

    CreateSQS

    1. Copy the below script and paste to JSON tab. Then click Review policy
    ,
        {
            "Effect": "Allow",
            "Action": "es:*",
            "Resource": "*"
        }

    CreateSQS

    1. Click Save changes

    CreateSQS

    1. Similarly, we will create a function to load streaming data from the DynamoDB into the OpenSearch instance.
    2. Back to AWS Lambda console, click Create function

    CreateSQS

    1. Enter the function name: load_stream
    • Selecting Runtime is Python 3.9
    • Click Create function

    CreateSQS

    1. Click Upload from, then select .zip file

    CreateSQS

    1. Click Upload and choose search_docs.zip file you just downloaded. Next click Save.

    CreateSQS

    1. Scroll down to bottom, in Runtime settings section, click Edit

    CreateSQS

    1. Repalce lambda_function with load_stream_data, then click Save

    CreateSQS

    1. Next, we will update the permissions for Lambda to be able to access the OpenSearch domain and DynamoDB.
    • Select Configuration tab and select Permission on the left menu.
    • Select the execution role of this function

    CreateSQS

    1. Click Add permissions and select Attach policies

    CreateSQS

    1. Enter AmazonOpenSearchServiceFullAccess and select that policy

    CreateSQS

    1. Enter AWSLambdaDynamoDBExecutionRole and select that policy. Then click Add permissions

    CreateSQS

    1. Open Amazon DynamoDB console
    2. Select Tables | Update settings on the left menu, then select Documents table
    3. Click Exports and streams tab

    CreateStream

    1. Scroll down to bottom, in DynamoDB stream details section, click Create trigger

    CreateStream

    1. Enter the lambda function: load_stream
      • Enter 1 for batch size
      • Click Create trigger

    CreateStream