Questions tagged with Amazon Managed Streaming for Apache Kafka (Amazon MSK)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Connector state information
Code: InvalidInput.WorkerLogsError
```
Message: Could not enable/disable worker logs. For more information, see the Amazon MSK Connect Developer Guide. Message: User:...
1
answers
0
votes
377
views
asked 4 months agolg...
[DestinationConfig](https://docs.aws.amazon.com/lambda/latest/dg/API_CreateEventSourceMapping.html#SSS-CreateEventSourceMapping-request-DestinationConfig) is a configuration object that specifies the...
1
answers
0
votes
1039
views
asked 4 months agolg...
We have a materialized view from a MSK topic with auto refresh on. We would like to delete rows that were ingested > 78 hours (see delete operation below). The DELETE SQL is syntactically correct but...
1
answers
0
votes
576
views
asked 4 months agolg...
MSK connectors are trying to create s3 sink connectors. At this time, schema uses the schema in the Glue schema registry, and the goal is to store avro schema in s3 in parquet format.
Below is the...
0
answers
0
votes
328
views
asked 4 months agolg...
**What I'm trying to do:**
I want to run the Python file in EC2 to send data to MSK, and I want to save the data in MSK in Parquet format in S3 through the Sink connector.
**Problem:**
An error...
0
answers
0
votes
335
views
asked 5 months agolg...
I am running into an issue with my MSK cluster's broker prometheus metrics. The JMX metrics endpoint constantly returns 429 (too many requests) errors when prometheus attempts to scrape the /metrics...
1
answers
1
votes
458
views
asked 5 months agolg...
![Enter image description here](/media/postImages/original/IMsCdSahucQjqNNIkdr0VPDw)
![Enter image description here](/media/postImages/original/IM8yhsUwYIQi6-xqogiklOuw)
Hi
AWS Kafka not working...
0
answers
0
votes
323
views
asked 5 months agolg...
I want to add Confluent Cloud Apache Kafka as a Data source in AWS ETL job to read data stream from Kafka topic.
I created a cluster, topic, AWS SQS source connector and AWS S3 sink connector in...
1
answers
0
votes
294
views
asked 5 months agolg...
I'm using an IoT rule to publish IoT data with Managed Service Kafka (MSK). However, I frequently encounter the following error, causing messages to be missing.
It generally works well, but what...
0
answers
0
votes
340
views
asked 5 months agolg...
Amazon MSK provides a metric named SumOffsetLag, described in the [documentation](https://docs.aws.amazon.com/msk/latest/developerguide/metrics-details.html) as
> The aggregated offset lag for all...
1
answers
0
votes
345
views
asked 5 months agolg...
In our architecture we have data from AWS MSK being ingested into AWS Redshift using the Amazon Redshift Streaming Ingestion feature. In this approach, we define an external schema where we have the...
0
answers
0
votes
113
views
asked 5 months agolg...
When I am using both the WHL file which contains all the packages and the glue connection which contains the broker of Kafka, it is giving an below mentioned error.
Error:
Glue ETL Marketplace -...
1
answers
0
votes
238
views
asked 6 months agolg...