Glue: Get Sink- Error "unsupported operand type(s) for +: 'JavaMember' and 'str'"

Question

Hello Members,
Please help with below issue, 
I am not able to find in documentation

I am trying below :
_____________________________________________
silver_target = glueContext.getSink(
            path='s3://bucketpath',
            connection_type="s3",
            updateBehavior='UPDATE_IN_DATABASE',
            partitionKeys=["pyear"],
            enableUpdateCatalog=True,
            transformation_ctx="silver_target",
        )

silver_target.setCatalogInfo(
    catalogDatabase=gluecatalogdb, catalogTableName=tableName
)
silver_target.setFormat("glueparquet")
silver_target.writeFrame(newdf)
_____________________________________________

newdf is : dataframe for existing data + new incremental data
so I tired :
appended_df=existing_df.union(newincremental_df)
newdf=appended_df.repartition(1)
_____________________________________________
After executing this I am getting error as 
TypeError: unsupported operand type(s) for +: 'JavaMember' and 'str'
_____________________________________________
I check the schema, count I see everything is matching , not sure what is going on in backend

Please help.
Thanks

Accepted Answer

Hi @rePost-User-5744318,

Could you please try to convert the glue dynamic frame to spark data frame, and apply union transformation.  It may give some better error logs, so that further troubleshooting can be performed.  Thank you :)

Answer

That's not a really a data error, that's sounds like API usage error or some print statement that is trying to concatenate.   
The stacktrace should tell you the line/API that is not used correctly

Glue: Get Sink- Error "unsupported operand type(s) for +: 'JavaMember' and 'str'"

相关内容