By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

StreamManger - UnknownFailureException: Broken bit parity - re:post

0

Hi there, i just upgrade my Greengrass (GG) core software from 1.10 to 1.11.5. Cus i want to use S3ExportTaskDefinition. However there is some error with the create_message_stream() the attached is the log of my lambda (which i copy from: https://github.com/aws-greengrass/aws-greengrass-stream-manager-sdk-python)

I manually trackback and found the error at line 336 result = await self.__requests[data.request_id].get() in the streammanagerclient.py::__send_and_receive()

GGStreamManager.log

[2022-02-28T16:43:51.367+11:00][ERROR]-Feb 28, 2022 4:43:51 PM com.amazonaws.internal.DefaultServiceEndpointBuilder getServiceEndpoint
[2022-02-28T16:43:51.367+11:00][ERROR]-INFO: {iotsitewise, ap-southeast-2} was not found in region metadata, trying to construct an endpoint using the standard pattern for this region: 'iotsitewise.ap-southeast-2.amazonaws.com'.
[2022-02-28T16:43:51.646+11:00][INFO]- (main) com.amazonaws.iot.greengrass.streammanager.server.StreamServer: Starting streamServer on port: 8088
[2022-02-28T16:43:51.665+11:00][INFO]- (main) com.amazonaws.iot.greengrass.streammanager.export.decider.Decider: Starting decider
[2022-02-28T16:43:52.186+11:00][INFO]- (pool-6-thread-1) com.amazonaws.iot.greengrass.streammanager.server.StreamServer: StreamServer ready to accept connections on port 8088
[2022-02-28T16:43:52.207+11:00][INFO]-Putting initialization result for function arn [arn:aws:lambda:::function:GGStreamManager:1] to http://localhost:8000/2016-11-01/functions/arn:aws:lambda:::function:GGStreamManager:1/initialized
[2022-02-28T16:43:52.377+11:00][INFO]-Put initialization result for function arn [arn:aws:lambda:::function:GGStreamManager:1]
[2022-02-28T16:43:53.407+11:00][ERROR]- (nioEventLoopGroup-3-1) com.amazonaws.iot.greengrass.streammanager.server.handlers.CreateMessageStreamRequestHandler: Encountered unknown exception while creating message stream SomeStatusStreamName
[2022-02-28T16:43:53.407+11:00][ERROR]-org.mapdb.DBException$PointerChecksumBroken: Broken bit parity
[2022-02-28T16:43:53.407+11:00][ERROR]- at org.mapdb.DataIO.parity4Get(DataIO.java:476) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at org.mapdb.StoreWAL.longStackLoadChunk(StoreWAL.kt:732) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at org.mapdb.StoreWAL.longStackPut(StoreWAL.kt:712) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at org.mapdb.StoreDirectAbstract.releaseData(StoreDirectAbstract.kt:367) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at org.mapdb.StoreWAL.updateProtected(StoreWAL.kt:455) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at org.mapdb.StoreWAL.update(StoreWAL.kt:426) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at org.mapdb.IndexTreeListJava.treePut(IndexTreeListJava.java:341) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at org.mapdb.IndexTreeLongLongMap.put(IndexTreeLongLongMap.kt:77) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at org.mapdb.HTreeMap.putprotected(HTreeMap.kt:363) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at org.mapdb.HTreeMap.put(HTreeMap.kt:324) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at com.amazonaws.iot.greengrass.streammanager.dao.MapDbMetadataDao.put(MapDbMetadataDao.java:73) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at com.amazonaws.iot.greengrass.streammanager.store.log.LogStore.createMessageStream(LogStore.java:113) ~[AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at com.amazonaws.iot.greengrass.streammanager.server.handlers.CreateMessageStreamRequestHandler.handle(CreateMessageStreamRequestHandler.java:41) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at com.amazonaws.iot.greengrass.streammanager.server.handlers.MessageStreamHandler.channelRead(MessageStreamHandler.java:133) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.407+11:00][ERROR]- at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [AWSGreengrassStreamManager.jar:?]
[2022-02-28T16:43:53.408+11:00][ERROR]- at java.lang.Thread.run(Thread.java:834) [?:?]

thanks for your help

Topics
Internet of Things (IoT)
Tags
AWS IoT GreengrassInternet of Things (IoT)
Language
English
AWS-User-6797102
asked 2 years ago237 views
2 Answers
1

It seems like the StreamManager metadata-store was corrupted.

  1. Could you elaborate on how you performed this upgrade? Did you perform OTA update?
  2. What was the exact GGC version before the upgrade?
  3. Was the OTA update job successful? Did the StreamManager system lambda start successfully after the upgrade?
  4. Could you also add the device specs: OS, CPU architecture?
  5. Were there any abrupt device-shutdowns while your lambda was exporting messages with StreamManager or during the upgrade?
  6. aws-greengrass-stream-manager-sdk-python is compatible with StreamManager running on GGC v1.11 and above. What version of StreamManager SDK were you using before the upgrade?
AWS
vaibhavmurkute
answered 2 years ago
  • AWS-User-6797102
    2 years ago

    Hi there thanks for your response. I will retry the upgrade again with diff device.

    1. i stopped greengrass service on the rpi, then run ota_agent -> create the update job with the IoT Core console (i follow this guide https://docs.aws.amazon.com/greengrass/v1/developerguide/core-ota-update.html#ota-permissions )
    2. 1.10.2
    3. Base on the console status, the update was success. Alos the SteamManager log shows it was ready
    4. rpi4 - 4Gb, Raspbian GNU/Linux 10 (buster) - armv7
    5. Nope
    6. StreamManager SDK 1.0.0
  • vaibhavmurkute
    2 years ago

    Thanks. Replicating the the same setup, I upgraded GGC from 1.10.5 to 1.11.5 with OTA update from console. I see no issues with my lambda using StreamManager after the upgrade. Please let us know in case you see this issue again on your retry.

0

i will try greengrass version 2

AWS-User-6797102
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content