Can we send CloudWatch Logs To OpenSearch "Serverless" Collection?

Question

This is on their website: Can use a CloudWatch Logs subscription to stream log data in near real time to an Amazon OpenSearch Service cluster. Does it mean it that we can stream log data to OpenSearch 'Serverless' collection?

Riku_Kobayashi · Accepted Answer

Hello.

Are you assuming the steps described in the documentation below?  
https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/CWL_OpenSearch_Stream.html

In that case, even if you create a Serverless cluster, you will not be able to configure it.  
I checked with my AWS account, and even though I was creating a Serverless cluster, I couldn't select it in the subscription filter.

rePost-User-4638280 · Answer

Hello!
This is possible, though the following steps are likely necessary:
- Create a transformation lambda to ensure that your logs are compliant with OpenSearch. 
- Setting up a Firehose stream (possibly with Kinesis prior to this) for the log stream pipeline
https://docs.aws.amazon.com/opensearch-service/latest/developerguide/serverless-clients.html#serverless-kdf
- Ensure that all roles (including the Lambda and Firehose IAM roles) have correct permissions and access to the required OpenSearch collection

Can we send CloudWatch Logs To OpenSearch "Serverless" Collection?

Añade tu respuesta

Contenido relevante