Unanswered Questions tagged with Amazon Kinesis

Content language: English

Sort by most recent

Browse through the questions and answers listed below or filter and sort to narrow down your results.

Greengrass - Stream Manager - Failed to establish connection with the server

Hi there, I've installed the stream manager via pip, also installed the stream manager component via AWS console and everything looks healthy. I am trying to run these samples from github: https://github.com/aws-greengrass/aws-greengrass-stream-manager-sdk-python/tree/main/samples and I am getting this error message (using sudo): ``` ERROR:StreamManagerClient:Received ConnectResponse with unexpected status ResponseStatusCode.Unauthorized. ERROR:root:Exception while running Traceback (most recent call last): File "s3.py", line 41, in main client = StreamManagerClient() File "/usr/local/lib/python3.8/dist-packages/stream_manager-1.1.1-py3.8.egg/stream_manager/streammanagerclient.py", line 114, in __init__ UtilInternal.sync(self.__connect(), loop=self.__loop) File "/usr/local/lib/python3.8/dist-packages/stream_manager-1.1.1-py3.8.egg/stream_manager/utilinternal.py", line 39, in sync return asyncio.run_coroutine_threadsafe(coro, loop=loop).result() File "/usr/lib/python3.8/concurrent/futures/_base.py", line 444, in result return self.__get_result() File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result raise self._exception File "/usr/local/lib/python3.8/dist-packages/stream_manager-1.1.1-py3.8.egg/stream_manager/streammanagerclient.py", line 152, in __connect await asyncio.wait_for(self.__connect_request_response(), timeout=self.request_timeout) File "/usr/lib/python3.8/asyncio/tasks.py", line 494, in wait_for return fut.result() File "/usr/local/lib/python3.8/dist-packages/stream_manager-1.1.1-py3.8.egg/stream_manager/streammanagerclient.py", line 309, in __connect_request_response raise ConnectFailedException("Failed to establish connection with the server") stream_manager.exceptions.ConnectFailedException: Failed to establish connection with the server ``` So the error says that if failed to establish a connection with the server, but I am not sure what server is it referring to? DId I miss a step somewhere? Cheers, Mark
0
answers
0
votes
27
views
asked a month ago

HIVE_PARTITION_SCHEMA_MISMATCH

Error: HIVE_PARTITION_SCHEMA_MISMATCH: There is a mismatch between the table and partition schemas. The types are incompatible and cannot be coerced. The column 'isfallbackkey' in table 'analytics.events' is declared as type 'boolean', but partition 'dt=2022-08-22/appid=jovo-game-starter' declared column 'translationkey' as type 'string'. Data was passed as JSON in this format: ``` {"type":"device_capabilities","supportScreen":true,"supportAudio":true,"supportLongformAudio":false,"supportVideo":false,"eventId":"668c9479-9eee-4025-8b9a-1323db06b21f","appId":"jovo-game-starter","eventDate":"2022-08-22T17:26:36.376Z","timestamp":1661189196,"locale":"en","timeZone":"America/Phoenix","userId":"a8ad82ba-bfac-4f93-a46d-aae37e842a7b","sessionId":"139163c0-fcf2-4bcc-9ece-a8e6ab5c322e"} {"type":"session_start","userId":"a8ad82ba-bfac-4f93-a46d-aae37e842a7b","sessionId":"139163c0-fcf2-4bcc-9ece-a8e6ab5c322e","eventId":"411e3abf-07fc-453c-9edd-a0a84f29b75f","appId":"jovo-game-starter","eventDate":"2022-08-22T17:26:36.383Z","timestamp":1661189196,"locale":"en","timeZone":"America/Phoenix"} {"type":"intent","userId":"a8ad82ba-bfac-4f93-a46d-aae37e842a7b","sessionId":"139163c0-fcf2-4bcc-9ece-a8e6ab5c322e","intent":"LAUNCH","eventId":"09287f39-e487-474b-bafc-c0c1b9f59959","appId":"jovo-game-starter","eventDate":"2022-08-22T17:26:36.387Z","timestamp":1661189196,"locale":"en","timeZone":"America/Phoenix"} {"type":"translation","translationKey":"start","isFallbackKey":false,"translationLanguage":"en","translationPlatform":"core","eventId":"15b87be7-5349-4a9e-b950-76bd76b63972","appId":"jovo-game-starter","eventDate":"2022-08-22T17:26:37.889Z","timestamp":1661189198,"locale":"en","timeZone":"America/Phoenix","userId":"a8ad82ba-bfac-4f93-a46d-aae37e842a7b","sessionId":"139163c0-fcf2-4bcc-9ece-a8e6ab5c322e"} ``` Using Kinesis Firehose dynamic partitioning: events/dt=!{partitionKeyFromQuery:dt}/appid=!{partitionKeyFromQuery:appid}/
0
answers
0
votes
54
views
asked 3 months ago

KCL1.x Java don't consuming records

I am using KCL 1.14.8 for Java. My Kinesis only have one shard, and I put a record into Kinesis every 30 seconds. For each record, the RecordProcessor will process it, processing each record may take several seconds(<10 seconds). This is worker configuration. ``` configuration.withInitialPositionInStream(InitialPositionInStream.LATEST) .withRegionName("eu-west-1") .withMaxRecords(10) .withIdleTimeBetweenReadsInMillis(1000L) .withCallProcessRecordsEvenForEmptyRecordList(false) .withRetryGetRecordsInSeconds(1) .withFailoverTimeMillis(60_000); ``` When the application start, It don't consuming records at all. the logs show this: ``` Aug 21, 2022 @ 21:24:14.943 Skipping shard sync due to the reason - Hash range is complete. Aug 21, 2022 @ 21:24:14.785 Number of pending leases to clean before the scan : 0 Aug 21, 2022 @ 21:24:00.144 Sleeping ... Aug 21, 2022 @ 21:24:00.144 Current stream shard assignments: shardId-000000000000 Aug 21, 2022 @ 21:23:14.911 Elected leaders: xxxxx-187a-4ceb-9714-e39ab1c7bb71 Aug 21, 2022 @ 21:23:14.785 Number of pending leases to clean before the scan : 0 Aug 21, 2022 @ 21:22:59.128 Sleeping ... Aug 21, 2022 @ 21:22:59.128 Current stream shard assignments: shardId-000000000000 Aug 21, 2022 @ 21:22:14.937 Skipping shard sync due to the reason - Hash range is complete. Aug 21, 2022 @ 21:22:14.785 Number of pending leases to clean before the scan : 0 Aug 21, 2022 @ 21:21:58.114 Current stream shard assignments: shardId-000000000000 Aug 21, 2022 @ 21:21:58.114 Sleeping ... Aug 21, 2022 @ 21:21:14.785 Number of pending leases to clean before the scan : 0 ``` please help.
0
answers
0
votes
25
views
shawn
asked 3 months ago