Troubleshooting Amazon OpenSearch Service
Check the following if data is not delivered to your OpenSearch Service domain.
Data can be backed up to your Amazon S3 bucket concurrently. If data was not delivered to your S3 bucket, see Troubleshooting Amazon S3.
-
Check the Kinesis Data Firehose
IncomingBytes
andIncomingRecords
metrics to make sure that data is sent to your Kinesis Data Firehose delivery stream successfully. For more information, see Monitoring Kinesis Data Firehose Using CloudWatch Metrics. -
If data transformation with Lambda is enabled, check the Kinesis Data Firehose
ExecuteProcessingSuccess
metric to make sure that Kinesis Data Firehose has tried to invoke your Lambda function. For more information, see Monitoring Kinesis Data Firehose Using CloudWatch Metrics. -
Check the Kinesis Data Firehose
DeliveryToAmazonOpenSearchService.Success
metric to make sure that Kinesis Data Firehose has tried to index data to the OpenSearch Service cluster. For more information, see Monitoring Kinesis Data Firehose Using CloudWatch Metrics. -
Enable error logging if it is not already enabled, and check error logs for delivery failure. For more information, see Monitoring Kinesis Data Firehose Using CloudWatch Logs.
-
Make sure that the OpenSearch Service configuration in your delivery stream is accurate and valid.
-
If data transformation with Lambda is enabled, make sure that the Lambda function that is specified in your delivery stream still exists. Also, make sure that the IAM role has access to CloudWatch log group and log streams to check error logs. For more information, see Grant Kinesis Data Firehose Access to a Public OpenSearch Service Destination.
-
Make sure that the IAM role that is specified in your delivery stream can access your OpenSearch Service cluster, S3 backup bucket, and Lambda function (if data transformation is enabled). Also, make sure that the IAM role has access to CloudWatch log group and log streams to check error logs. For more information, see Grant Kinesis Data Firehose Access to a Public OpenSearch Service Destination.
-
If you're using data transformation, make sure that your Lambda function never returns responses whose payload size exceeds 6 MB. For more information, see Amazon Kinesis Data Firehose Data Transformation
. -
Amazon Kinesis Data Firehose currently does not support the delivery of CloudWatch Logs to Amazon OpenSearch Service destination because Amazon CloudWatch combines multiple log events into one Firehose record and Amazon OpenSearch Service cannot accept multiple log events in one record. As an alternative, you can consider Using subscription filter for Amazon OpenSearch Service in CloudWatch Logs.