By using AWS re:Post, you agree to the Terms of Use
/Analytics/

Analytics

AWS provides the broadest selection of analytics services that fit all your data analytics needs and enables organizations of all sizes and industries reinvent their business with data. From data movement, data storage, data lakes, big data analytics, machine learning, and anything in between, AWS offers purpose-built services that provide the best price-performance, scalability, and lowest cost.

Recent questions

see all
1/18

Trying to track redshift Assert error

Since today we are having this error, the DBT/SQL was not touched I'm receiving errors in many processes with this same message. A full refresh on DBT clears it, but when the first incremental runs, it starts to fail again with the same error, "context" is not helping. I ran the query manually and had no trouble at all. It's a query that creates a table, a delete on the destination table (with a where), and inserts into it (managed by DBT that wasn't modified for more than 6 months, the query runs daily and also wasn't changed on the last months). The only thing that I think changed was the Redshift version via an auto-maintenance yesterday, but can't do a rollback to validate, or can I? I was in "current" version on maintenance, just switched to "trailing", now I'm on 1.0.38361, and can't find the changelog for that version. ``` 20:26:44 | 20:26:44 | 1 of 1 START incremental model xxxxxx......... [RUN] 20:26:51 | 1 of 1 ERROR creating incremental model xxxxxx [ERROR in 6.44s] 20:26:51 | 20:26:51 | Finished running 1 incremental model in 8.55s. Completed with 1 error and 0 warnings: Database Error in model xxxxx (models/xxxxx.sql) Assert DETAIL: ----------------------------------------------- error: Assert code: 1000 context: size >= 0 - size=-2, 0=0. query: 62706875 location: tbl_trans.cpp:867 process: padbmaster [pid=70356] ----------------------------------------------- compiled SQL at target/run/xxxxx/xxxxx.sql Done. PASS=0 WARN=0 ERROR=1 SKIP=0 TOTAL=1 ``` Any idea of what can be happening? Thanks!
1
answers
0
votes
2
views
AWS-User-3279708
asked 13 hours ago

_temp AWS lake formation blueprint pipeline tables appears to IAM user in athena editor although I didn't give this user permission on them

_temp lake formation blueprint pipeline tables appears to IAM user in Athena editor, although I didn't give this user permission on them below the policy granted to this IAM user,also in lake formation permsissions ,I didnt give this user any permissions on _temp tables: { "Version": "2012-10-17", "Statement": [ { "Sid": "Stmt1652364721496", "Action": [ "athena:BatchGetNamedQuery", "athena:BatchGetQueryExecution", "athena:GetDataCatalog", "athena:GetDatabase", "athena:GetNamedQuery", "athena:GetPreparedStatement", "athena:GetQueryExecution", "athena:GetQueryResults", "athena:GetQueryResultsStream", "athena:GetTableMetadata", "athena:GetWorkGroup", "athena:ListDataCatalogs", "athena:ListDatabases", "athena:ListEngineVersions", "athena:ListNamedQueries", "athena:ListPreparedStatements", "athena:ListQueryExecutions", "athena:ListTableMetadata", "athena:ListTagsForResource", "athena:ListWorkGroups", "athena:StartQueryExecution", "athena:StopQueryExecution" ], "Effect": "Allow", "Resource": "*" }, { "Effect": "Allow", "Action": [ "glue:GetDatabase", "glue:GetDatabases", "glue:BatchDeleteTable", "glue:GetTable", "glue:GetTables", "glue:GetPartition", "glue:GetPartitions", "glue:BatchGetPartition" ], "Resource": [ "*" ] }, { "Sid": "Stmt1652365282568", "Action": "s3:*", "Effect": "Allow", "Resource": [ "arn:aws:s3:::queryresults-all", "arn:aws:s3:::queryresults-all/*" ] }, { "Effect": "Allow", "Action": [ "lakeformation:GetDataAccess" ], "Resource": [ "*" ] } ] }
1
answers
0
votes
2
views
AWS-User-6747057
asked 3 days ago

AWS GLUE Image certificate related issue

Hello Team , I have created Docker compose file mentioned below : ``` version: "2" services: spark: image: glue/spark:latest container_name: spark ** build: ./spark** hostname: spark ports: - "8888:8888" - "4040:4040" entrypoint : sh command : -c "/home/glue_user/jupyter/jupyter_start.sh" volumes: - ../app/territoryhub-replication:/home/glue_user/workspace/jupyter_workspace ``` Docker file which is getting called in build section is as follows : ``` FROM amazon/aws-glue-libs:glue_libs_3.0.0_image_01 USER root RUN mkdir -p /root/.aws RUN echo "[default]\nregion=us-east-1" >> /root/.aws/config ``` My Docker is getting started but failing (sharing logs ) Starting Jupyter with SSL /home/glue_user/jupyter/jupyter_start.sh: line 4: livy-server: command not found [I 2022-05-12 15:41:33.032 ServerApp] jupyterlab | extension was successfully linked. [I 2022-05-12 15:41:33.044 ServerApp] nbclassic | extension was successfully linked. [I 2022-05-12 15:41:33.046 ServerApp] Writing Jupyter server cookie secret to /root/.local/share/jupyter/runtime/jupyter_cookie_secret [I 2022-05-12 15:41:33.541 ServerApp] sparkmagic | extension was found and enabled by notebook_shim. Consider moving the extension to Jupyter Server's extension paths. [I 2022-05-12 15:41:33.541 ServerApp] sparkmagic | extension was successfully linked. [I 2022-05-12 15:41:33.541 ServerApp] notebook_shim | extension was successfully linked. [W 2022-05-12 15:41:33.556 ServerApp] All authentication is disabled. Anyone who can connect to this server will be able to run code. [I 2022-05-12 15:41:33.558 ServerApp] notebook_shim | extension was successfully loaded. [I 2022-05-12 15:41:33.560 LabApp] JupyterLab extension loaded from /usr/local/lib/python3.7/site-packages/jupyterlab [I 2022-05-12 15:41:33.560 LabApp] JupyterLab application directory is /usr/local/share/jupyter/lab [I 2022-05-12 15:41:33.565 ServerApp] jupyterlab | extension was successfully loaded. [I 2022-05-12 15:41:33.569 ServerApp] nbclassic | extension was successfully loaded. [I 2022-05-12 15:41:33.569 ServerApp] sparkmagic extension enabled! [I 2022-05-12 15:41:33.569 ServerApp] sparkmagic | extension was successfully loaded. Traceback (most recent call last): File "/usr/local/bin/jupyter-lab", line 8, in <module> sys.exit(main()) File "/usr/local/lib/python3.7/site-packages/jupyter_server/extension/application.py", line 584, in launch_instance serverapp = cls.initialize_server(argv=args) File "/usr/local/lib/python3.7/site-packages/jupyter_server/extension/application.py", line 557, in initialize_server find_extensions=find_extensions, File "/usr/local/lib/python3.7/site-packages/traitlets/config/application.py", line 88, in inner return method(app, *args, **kwargs) File "/usr/local/lib/python3.7/site-packages/jupyter_server/serverapp.py", line 2421, in initialize self.init_httpserver() File "/usr/local/lib/python3.7/site-packages/jupyter_server/serverapp.py", line 2251, in init_httpserver max_buffer_size=self.max_buffer_size, File "/usr/local/lib64/python3.7/site-packages/tornado/util.py", line 288, in __new__ instance.initialize(*args, **init_kwargs) File "/usr/local/lib64/python3.7/site-packages/tornado/httpserver.py", line 191, in initialize read_chunk_size=chunk_size, File "/usr/local/lib64/python3.7/site-packages/tornado/tcpserver.py", line 134, in __init__ 'certfile "%s" does not exist' % self.ssl_options["certfile"] **ValueError: certfile "/home/glue_user/.certs/my_key_store.pem" does not exist** Please help in resolving this asap Many Thanks
1
answers
0
votes
1
views
AWS-User-6494745
asked 4 days ago

Popular users

see all
1/18

Learn AWS faster by following popular topics

1/3