Questions tagged with Serverless

I make pytorch model with sagemaker, MMS. This is my mms code. ```python %%time instance_type = 'c5.large' # accelerator_type = 'eia2.medium' predictor = mme.deploy( initial_instance_count=1, instance_type=f"ml.{instance_type}" ) mme.add_model(model_data_source=model_path, model_data_path="model.tar.gz") list(mme.list_models()) #> [ 'model.tar.gz'] ``` I try to predict with this code. ```python start_time = time.time() predicted_value = predictor.predict(requests, target_model="LV1") duration = time.time() - start_time print("${:,.2f}, took {:,d} ms\n".format(predicted_value[0], int(duration * 1000))) ``` And, return error message. ``` ModelError: An error occurred (ModelError) when calling the InvokeEndpoint operation: Received server error (500) from model with message "{ "code": 500, "type": "InternalServerException", "message": "Failed to start workers" } ``` MMS with pytorch is 'little' difficult. X) help me, please.lg...

Hello, we are trying to use `stepfunctions-local` (Docker version) and _Mocked Service Integrations_ to unit test our state machines. So far, it works great. The problem is, that the tests take too long, when there is a `Wait` or `Retry` logic in the step machine. `stepfunctions-local` execution waits the time that is defined in the state machine definition. I've seen that `stepfunctions-local` has the (rather undocumented) parameter `WAIT_TIME_SCALE`. From the Docs: https://docs.aws.amazon.com/step-functions/latest/dg/sfn-local-config-options.html  I've set it to `0` but the execution still waits the seconds we specified in the definition, which makes the unit test unnecessarily slow. Can you help me understand wether I'm doing something wrong? What is the `WAIT_TIME_SCALE` parameter anyway? Thanks! Eneslg...

Hello, How do we pass application.conf or properties file to spark jobs on emr serverless, in standard EMR we copy properties or conf files to master node /home/hadoop/?lg...

Hello all, We have one serverless v1 in production and the last few days I see in logs that it restarts in about every 4 hours.  I see in the log that it started up.lg...

I have an use case where we are using Camel Kafka client and need access to Zookeeper. We also were planning to use MSK severless so that we don't have to worry about Broker nodes going down or rebalancing the partitions. I could not find a way to access zookeeper information with MSK server less. Any help would be greatly appreciated.lg...

Hi, just wondering, during docker build, if I install node packages in the folder `/opt/nodejs` and copy the folder `node_modules/` plus files `package.*` to the final image like the following: ``` FROM public.ecr.aws/lambda/nodejs:16 as builder WORKDIR /opt/nodejs RUN npm install pkg1 pkg2 pkg3 FROM public.ecr.aws/lambda/nodejs:16 COPY --from=builder /opt/nodejs /opt/nodejs COPY . ${LAMBDA_TASK_ROOT} ``` would this be a valid way to create a lambda layer? Thanks!lg...

Hi, I am working on a CDK app with some lambda and layers, and the following is my file structure: ``` /root |-bin |-lib |-src/ |-layers/ | |-nodejs/ | |-helper.js |-lambda/ |-index.js ``` lambda/index.js: ``` import { MyHelper } from "../layers/nodejs/helper.js" // import { MyHelper } from "/opt/nodejs/helper" ``` The problem is that when working on the local machine, I import the module using the frist path, and when deploying the lambda via cdk, I have to change the path into `/opt/nodejs/helper` since that is where the lambda loads the layer. It soon becomes a very frustrating job when the number of lambda function & layer grows. I've tried setting `jsconfig.json` like the following: ``` { "compilerOptions": { "baseUrl": "./", "module": "ES6", "paths": { "/opt/nodejs/*": ["src/layers/nodejs/*"] } } } ``` But for some unknown reason, node on my machine can't find the module with `import { MyHelper } from "/opt/nodejs/helper"`, not even with `import { MyHelper } from "src/layers/nodejs/helper.js"`. I still have to use the relative path to make the function works. So, is there a better way to handle the Lambda layer referencing? Thanks!lg...

Hi all, I'm starting a new team to develop solutions in AWS Cloud ecosystem. We will be using python as programming language and we inteend to use AWS CloudFormation to configure templates and start using them as IaC to setup our application. We are intending to use PyCharm as IDE, however i'm looking for tips from the community to understand what are the best tools to work for the described environment. Note that we intend to have a full serverless application. Any software, IDEs or tools suggestions that could make development easier are welcomed! Thanks in advance.lg...

I'm filtering out unconfirmed emails in lambda function. I jsut want to access email of every user in my listUsersRes.Users. I have tried for listUsersRes.Users[0].Username it is returning username perfectly. But when I'm trying listUsersRes.Users[0].Email or listUsersRes.Users[0].userAttributes.email or listUsersRes.Users[0].request.userAttributes.email it is returning null. I have aslo AttributesToGet: ["email"].But I don't know why it is not working for email. **My function:** ``` exports.handler = async (event, context, callback) => { const cognitoProvider = new aws.CognitoIdentityServiceProvider({apiVersion: "2016-04-18"}); if (event.triggerSource == "PreSignUp_SignUp" ||event.triggerSource == "PreSignUp_AdminCreateUser" || event.triggerSource=="PreSignUp_ExternalProvider") { try { const listUserParams={UserPoolId: event.userPoolId,AttributesToGet: ["email"],Filter: `cognito:user_status= \"${"UNCONFIRMED"}\"`, Limit: 10 }; const listUsersRes = await cognitoProvider.listUsers(listUserParams).promise(); if (listUsersRes.Users.length >= 0) { return callback(new Error(listUsersRes.Users[0].Username), event);//this line I'm modifying to get email attribute form listUsersRes.Users[0] } } catch (error) {return callback(new Error("catch error"), event);} } else { var error = "This provider is not supported"; callback(new Error(error), event); } }; ``` **my permission:** ``` "Sid": "VisualEditor0", "Effect": "Allow", "Action": [ "logs:CreateLogStream", "logs:PutLogEvents", "cognito-idp:AdminInitiateAuth", "cognito-idp:ListUsers", "cognito-idp:AdminUpdateUserAttributes", "cognito-idp:AdminGetUser" ], ```lg...

I updated my state machine to use a task token and now it's timing out when it gets to the choice. This was previously working, and the cloudwatch logs for the first supportticketparse lambda function aren't indicating that anything is wrong. My guess is that I have and error in the payload definition, but I'm not sure. Is anything obviously wrong with the definition? If not, where else can I look for a potential problems? ``` { "Comment": "A description of my state machine", "StartAt": "zen sort", "TimeoutSeconds": 60, "States": { "zen sort": { "Type": "Task", "Resource": "arn:aws:states:::lambda:invoke.waitForTaskToken", "OutputPath": "$.Payload", "Parameters": { "FunctionName": "arn:aws:lambda:us-east-1:363540650061:function:support-ticket-parse:$LATEST", "Payload": { "ExecutionContext.$": "$$", "APIGatewayEndpoint": "https://9084s1lza7.execute-api.us-east-1.amazonaws.com/test/", "Payload.$": "$" } }, "Next": "Choice" }, "Choice": { "Type": "Choice", "Choices": [ { "Variable": "$.name", "StringMatches": "New User Account ", "Next": "send email" }, { "Not": { "Variable": "$.name", "StringMatches": "New User Account " }, "Next": "Fail" } ], "Default": "Fail" }, "send email": { "Type": "Task", "Resource": "arn:aws:states:::lambda:invoke.waitForTaskToken", "OutputPath": "$.Payload", "Parameters": { "FunctionName": "arn:aws:lambda:us-east-1:363540650061:function:send_email:$LATEST", "Payload": { "ExecutionContext.$": "$$", "APIGatewayEndpoint": "https://9084s1lza7.execute-api.us-east-1.amazonaws.com/test/", "Payload.$": "$" } }, "Retry": [ { "ErrorEquals": [ "Lambda.ServiceException", "Lambda.AWSLambdaException", "Lambda.SdkClientException" ], "IntervalSeconds": 2, "MaxAttempts": 6, "BackoffRate": 2 } ], "End": true }, "Fail": { "Type": "Fail" } } } ```lg...

[ERROR] ClientError: An error occurred (AccessDenied) when calling the PutObjectTagging operation: Access Denied Traceback (most recent call last): File "/var/lang/lib/python3.8/site-packages/aws_lambda_powertools/metrics/metrics.py", line 184, in decorate response = lambda_handler(event, context) File "/var/lang/lib/python3.8/site-packages/aws_lambda_powertools/logging/logger.py", line 354, in decorate return lambda_handler(event, context, *args, **kwargs) File "/var/task/lambda.py", line 75, in lambda_handler set_status(input_bucket, input_key, INPROGRESS) File "/var/task/lambda.py", line 116, in set_status s3_client.put_object_tagging( File "/var/lang/lib/python3.8/site-packages/botocore/client.py", line 508, in _api_call return self._make_api_call(operation_name, kwargs) File "/var/lang/lib/python3.8/site-packages/botocore/client.py", line 915, in _make_api_call raise error_class(parsed_response, operation_name) Can any one help me to resolve the issue. I double checked my IAM roles adn could not resolve the issue.lg...

Hello all, AWS and node.js noob here. I am trying to save a code captured from URL parameters to my parameters store in the System Manager service, and later return a hashed value from various strings. My code returns the hash and I don't have any errors in the console, but when I test it with URL/?code=1234&challenge_code=5678, nothing changes in my parameter store. I already have an object named ebayUserCode in there of type string. ``` exports.handler = async (event) => { const crypto = require('crypto'); const AWS = require('aws-sdk') let verificationToken = "FIXME"; let endpoint = "FIXME"; let code = "code"; let challengeCode = "challenge_code"; if (event.queryStringParameters && event.queryStringParameters.code) { console.log("Received name: " + event.queryStringParameters.code); code = event.queryStringParameters.code; var ssm = new AWS.SSM(); var params = { Name: 'ebayUserCode', /* required */ Value: code, /* required */ Overwrite: true }; ssm.putParameter(params, function(err, data) { if (err) console.log(err, err.stack); // an error occurred else console.log(data); // successful response }); } if (event.queryStringParameters && event.queryStringParameters.challengeCode) { console.log("Received name: " + event.queryStringParameters.challengeCode); challengeCode = event.queryStringParameters.challengeCode; } const hash = crypto.createHash('sha256'); hash.update(challengeCode); hash.update(verificationToken); hash.update(endpoint); const responseHash = hash.digest('hex'); console.log(new Buffer.from(responseHash).toString()); const response = { statusCode: 200, body: responseHash, }; return response; }; ``` What am I doing wrong? Any help would be greatly appreciated. Thanks in advance!lg...