Microservices

I've been trying to figure out how my AWS Connect agents can transfer calls to each other via the **quick connect** feature in connect. Everything starts well but after a few seconds the agent interface hangs and goes blank leaving the agent without the ability to control his CCP and leaving the customer on hold until he decides to hang up himself. We tried to see if it turned out to be a bug in the transfer flow we have, but found nothing out of the ordinary. Other methods like **Service Limit Increase** have been tried but none with good results. Any advice please?lg...

Hi, I am building a service which need a queue for sending message from one service to another service. For this i need a FIFO queue but FIFO queue has a API call limit of 3000/sec and with batch of 10 message i can maximum get 30000 message per second. But my Application need more API Call limit as i need around 50k to 60k message per second. Is this possible by any way that i can achieve this limit with SQS FIFO. Or is there any other solution for this problem?lg...

We have a document upload Lambda created which generates a signed url of s3 bucket for PUT api. This PUT api is being used by front-end to store the file in S3 bucket. In the front end screen we have to upload 5 files and for each file upload it first generates the signurl by invoking the lambda then use the signed url to upload physical file. The first file upload takes around 15 second where as the 2nd/3rd/.. files takes around 2 sec to upload the same size of (200kb) file. Is the any way to enhance this s3 put api response for first upload.lg...

Hi, I have had an API gateway running as a webhook receiver -> SQS for a little over a month with no issues. As of 9/26, I started receiving an error on all requests on my only endpoint for this API two days ago. ``` { "Error": { "Code": "MalformedQueryString", "Message": "Keys may not contain ", "Type": "Sender" }, "RequestId": "XXXXX" } ``` This is the end points def in template. ``` responses: default: statusCode: "200" requestParameters: integration.request.header.Content-Type: "'application/x-www-form-urlencoded'" requestTemplates: application/json: "Action=SendMessage&MessageBody=$input.body" passthroughBehavior: "never" type: "aws" ``` Issue I am having is that the message body to the API is always truncated, with no discernable difference in the first 1024kb of the data with historical vs new messages that are failing. I can only assume after the first 1024kb of data, there must be a difference in the message being received? How do I troubleshoot this further?lg...

My question is: On the API GW resource integration request endpoiint URL, what should it be if I have a VPC LINK+NLB+ALB+EC2? Should it be the NLB's DNS or the raw endpoint (i.e. myec2.scope.com/REST/ExampleCall) We have an API first architecture, so everything is private except the API Gateway. It will flow like API Gateway -> VPC Link -> Network Load Balancer -> Application load balancer -> EC2 (REST API END POINT) I skimmed the white paper https://docs.aws.amazon.com/whitepapers/latest/best-practices-api-gateway-private-apis-integration/best-practices-api-gateway-private-apis-integration.pdf?did=wp_card&trk=wp_card but couldn't find a definitive answer. Also for TLS, does it terminate at the ALB or the EC2? Thank youlg...

we have crated ElastiCache ( redis cluster ) and we would like to integrate ElastiCache ( redis cluster ) through secrets manager in our code (.net ), can any one help on this. we have integrated RDS in our code through secrets manager and we are trying to achieve the same using ElastiCache ( redis cluster ) , please advise if its possible.lg...

Hello. I wrote a code in Python that extracts data from the FTX exchange using their API. I am running the code in an AWS instance (free plan, t2.micro), located very closeby to the servers of the exchange. The code is essentially an infinite loop. At each step, it sends 3 'GET' requests, elaborates the response, and then goes to the next step. For the first few hundred iterations, the latency (defined below at the end of the post) for each block of three requests is of the order of 0.3seconds. After some time, it starts to grow up, reaching values from 2 to 5 seconds. In my local computer, located in the US, the latency is pretty constant at 1 second. There are no ratelimits in the FTX API for `GET` requests, so I should not expect any limit from the server. Is AWS limiting the rate of `GET` requests that I can make? I am trying to understand the origin of this extra-latency. To do so, I have monitored the https data traffic with `tcpdump` and I have modified the python script so that it stops as soon as it experiences a latency > 2 seconds. In this way, I can isolate the last packets in the tcpdump output and try to understand the origin of the delay. However, I really don't know how to read the output (I uploaded it here https://pastebin.com/tAhcicPU). Can anyone help me to understand the origin of the latency? 104.18.33.31.443 is the IP of FTX server 172.31.9.8 is the IP of the machine where my code runs **Definition of latency used here**: I post the relevant part of the code where I compute the latency ``` latency=0 for pair in pairList: # pairList = ['BTC/USD','ETH/BTC','ETH/USD'] api=requests.get(f'https://ftx.com/api/markets/{pair}/orderbook?depth={20}') latency+=api.elapsed.total_seconds() return latency ``` So, it is the total sum of the latency returned by the requests.get for each request.lg...

I'm constantly getting response time **more than 1000ms** even in a simple query(**average 1200ms**) in ```VTL resolvers```. But in ```Lambda```, by default configuration I'm getting average **700ms** and after changing the configuration I can achieve **less than 100ms latency** in ```Lambda resolver```. **We can say ```VTL``` is slower than ```Lambda``` !** How can I increase the speed of VTL?lg...

Hi team, I'm creating an ec2 instance via CDK, but I can't find how to set: - Termination protection (Enabled) - Answer private resource DNS name (IPv4 (A)) I can't find those 2 properties on `InstanceProps` interface are they supported by CDK? Thank you!lg...

Hi team, I created an ec2 instance with CDK and added used data on it : ``` const userData = readFileSync("lib/my-script.sh", "utf8"); instance.addUserData(userData); instance.applyRemovalPolicy(RemovalPolicy.DESTROY); ``` my-script.sh : ``` #! /bin/bash sudo su yum -y update # adding MYSQL client to connect to RDS(MYSQL) instance. sudo yum install mysql ``` but when i connect to my ec2 instance via the session manager tab and do MySQL command I have this error : `sh: mysql: command not found` looks like the user data script was not run. I'm I missing something? how can I know if the user data script was successfully run on the ec2 instance? found this on : `/var/log/cloud-init-output.log` ``` Sep 15 00:17:50 cloud-init[xxxx]: util.py[WARNING]: Failed running /var/lib/cloud/instance/scripts/part-001 [1] Sep 15 00:17:50 cloud-init[xxxx]: cc_scripts_user.py[WARNING]: Failed to run module scripts-user (scripts in /var/lib/cloud/instance/scripts) Sep 15 00:17:50 cloud-init[xxxx]: util.py[WARNING]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_scripts_user.pyc'>) failed ci-info: no authorized ssh keys fingerprints found for user ec2-user. ``` thank you!lg...

Hello, I have two SQS queues: one in us-east-1, and one in us-west-1. Currently my Step Function state machine is located in us-west-1, and has no trouble calling SQS API actions on the us-west-1 queue; however, any actions on the us-east-1 queue fail saying the queue cannot be found. Do Step Functions support using a queue outside of the state machine's region? If so, where is the parameter to set the queue region?lg...

To collect traces from DAPR we are using Opentelemetry collector and using Zipkin receiver since that's supported by DAPR and using awsxray exporter in open telemetry configuration. We see the traces generated in Opentelemetry log, however we do not see traces collected in AWS Xray. Please let us know what could be the issue Open telemetry configuration: receivers: zipkin: endpoint: 0.0.0.0:9411 otlp: protocols: grpc: endpoint: 0.0.0.0:4317 http: endpoint: 0.0.0.0:4318 awsxray: awsxray/udp_endpoint: endpoint: "0.0.0.0:5678" transport: udp awsxray/proxy_server: proxy_server: endpoint: "0.0.0.0:1234" tls: insecure: true region: ap-south-1 Exporter configuration: awsxray: region: ap-south-1 index_all_attributes: true resource_arn: "arn:aws:iam::215977048474:role/EKS-NodeGroup" #role_arn: "arn:aws:iam::215977048474:role/MastBazaar-EKS" no_verify_ssl: true Service configuration: service: extensions: [pprof, zpages, health_check] pipelines: traces: receivers: [zipkin] # List your exporter here. exporters: [awsxray,logging] Also added environment variable OTEL_PROPAGATORS: "xray" in deployment as seen below containers: - name: otel-collector image: otel/opentelemetry-collector-contrib-dev:latest env: - name: OTEL_PROPAGATORS value: "xray" Sample log in open telemetry 2022-09-13T18:15:46.106Z INFO loggingexporter/logging_exporter.go:42 TracesExporter {"#spans": 1} 2022-09-13T18:15:46.106Z DEBUG loggingexporter/logging_exporter.go:51 ResourceSpans #0 Resource SchemaURL: Resource labels: -> service.name: STRING(multiplyapp) ScopeSpans #0 ScopeSpans SchemaURL: InstrumentationScope Span #0 Trace ID : 5db6a8eb0ade84a251ca547034b13c5f Parent ID : 9987294085d81f24 ID : f88d24f02301bf28 Name : CallLocal/multiplyapp/multiply Kind : SPAN_KIND_SERVER Start time : 2022-09-13 18:15:44.031751 +0000 UTC End time : 2022-09-13 18:15:45.034974 +0000 UTC Status code : STATUS_CODE_UNSET Status message : Attributes: -> dapr.api: STRING(/dapr.proto.internals.v1.ServiceInvocation/CallLocal) -> dapr.invoke_method: STRING(multiply) -> dapr.protocol: STRING(grpc) -> rpc.service: STRING(ServiceInvocation) -> net.host.ip: STRING(10.0.195.115) 2022-09-13T18:15:54.505Z INFO loggingexporter/logging_exporter.go:42 TracesExporter {"#spans": 1} 2022-09-13T18:15:54.505Z DEBUG loggingexporter/logging_exporter.go:51 ResourceSpans #0 Resource SchemaURL: Resource labels: -> service.name: STRING(multiplyapp) ScopeSpans #0 ScopeSpans SchemaURL: InstrumentationScope Span #0 Trace ID : c3f98c14589d4618899f4581503e4c3f Parent ID : 642dd665bbc6c3dd ID : 014fec0dfb862b5c Name : CallLocal/multiplyapp/multiply Kind : SPAN_KIND_SERVER Start time : 2022-09-13 18:15:53.489635 +0000 UTC End time : 2022-09-13 18:15:54.492579 +0000 UTC Status code : STATUS_CODE_UNSET Status message : Attributes: -> dapr.api: STRING(/dapr.proto.internals.v1.ServiceInvocation/CallLocal) -> dapr.invoke_method: STRING(multiply) -> dapr.protocol: STRING(grpc) -> rpc.service: STRING(ServiceInvocation) -> net.host.ip: STRING(10.0.195.115) Any guidance will be very much appreciatedlg...

Hi team, I have a list of CDK stacks I can deploy in my dev, stage and prod AWS accounts. one of my stacks (the ECR stack) is deployed only in the DEV account (as a single source of docker images), how can I pass the ECR repository URI to my other stack (the EcsfargateStack) when I deploy to the other accounts: prod and stage? in dev I do like this : ``` const ecsfargateStack= new EcsfargateStack(app, "EcsfargateStack", { env: env, ecrRepoUri: ECRRepositoryStack.repositoryUri, //repositoryUri exported value from the ECRRepositoryStack }); ``` but in stg and prod **ECRRepositoryStack** is not deployed but I still need to deploy ecsfargateStack in prod and stg and give them **ECRRepositoryStack**.repositoryUri, like above how can I get **ECRRepositoryStack**.repositoryUri to pass it in my ecsfargateStack in stg and prod knowing that ECRRepositoryStack is uniquely deployed in DEV ? ==> stack_A(generate repoUri property) is deployed only in account 123, then the property generated in StackA in account 123 needs to be used by Stack_B in accounts 456 and 789. thank you!!!lg...

Kube-controller pod in AWS EKS is consuming a majority of the CPU and memory resources.How to reduce it and make it available for the podslg...

My app is a social media clone app. I want a logic like below for my home feed: **amplify api will fetch list of 10 items through pagination** -> **this 10 items will be showing up to user in feed** -> **when user reaches the 7th item on the screen I will fetch again 10 items through api call and save it to local datastore**-> **when user will reach the end item/10th item i will show the next 10 items present in local datastore and I will clear that 10 items in local storage**-> **and fetch next 10 items**-> **if user closes app immediately the 10 items will be there in local storage**-> **next time when user will open app I will show the data without buffer form local storage** My issue is how if user likes a post or makes a comment I will save that to data store for short time and when sync event occurs I will update that like and comment to DynamoDB. **1.** My question is how to delete some specific data when some event occurs like list of post? **2.** Can we upload new post from datastore? how?lg...

Good morning everyone, I am just starting in the AWS world and I have a challenge that I need to solve with the most appropriate tools that AWS offers me. The use case is the following: I have to process some pdf documents add some images to them and send it back. Currently I am doing it with a microservice that receives a pdf and returns it modified. When I do load tests the queue receives 50 requests and in the bash task I get blocked with 9 pdf at the same time and the ECS crashes. One solution is to increase the capacity of the ECS so that the microservice can process more documents. But I have read that SQS can help me solve this so I want to be sure I am applying the right architecture: - I have a .net core microservice in docker that produces requests and sends them to the queue. - I have an SQS that receives requests and arranges them in order of arrival. - I have a lambda that listens to the SQS and when a new request arrives it fires the event to the consuming microservice (the lambda "fires" up to 10 times simultaneously and in each "firing" it lets only 1 document through, or they recommend that in each "firing" it lets 10 documents through). - The consuming microservice receives a message from the lambda and starts processing all the SQS requests until all of them are finished. - When finished and the SQS is emptied the lambda again is waiting for the SQS to have a new message and the cycle starts again. Overview: I have a microservice is publisher. The microservice is consumer The lambda is the trigger The SQS is the queuelg...

We're a small startup based in Malaysia and I'm the technical founder of the startup. We have a plan for all our services working on AWS. We have startup credits, so we want to use them and launch to start getting some returns that we can use to continue supporting our costs. We're planning to build a micro-service architecture. It'll have two mobile apps for different stakeholders. The app consists of functionalities like Auth/Login, Chat, Payment (Possibly we'll be using Stripe), Accounts/Receipts, AI-based recommendations, and others. I have been learning what I can about AWS and have a solid understanding of what Amplify is. I also understand that in order to make a micro-service I can start an RDS and connect it with an EC2 and a node or any project that works as an API. But I might need more grooming on the EC2. So, I guess my first question would be: "Is it a good approach that we have multiple Amplify projects each used as a micro-service?" I understand that at the start we might not have that many users but this will be a solution that when scaled would require less effort in the future. My second question would be based on the above idea which architecture would you recommend if not the one?lg...

hi, we are geting this error in the logs and have no clue why, we have a lambda which does a scan on dynambd, the lambda seems to throw an error count at the time, there seems to be nothing in dynamdb, this is the error, can anyone tell me why this is happening? { "errorType": "ValidationException", "errorMessage": "Invalid FilterExpression: Expression size has exceeded the maximum allowed size; expression size: 4172", "code": "ValidationException", "message": "Invalid FilterExpression: Expression size has exceeded the maximum allowed size; expression size: 4172", "time": "2022-09-07T16:12:20.819Z", "requestId": "RG2TJNCJ36LIHKIHPJ8V7BQ3ARVV4KQNSO5AEMVJF66Q9ASUAAJG", "statusCode": 400, "retryable": false, "retryDelay": 6.469955607178434, "stack": [ "ValidationException: Invalid FilterExpression: Expression size has exceeded the maximum allowed size; expression size: 4172", " at Request.extractError (/var/runtime/node_modules/aws-sdk/lib/protocol/json.js:52:27)", " at Request.callListeners (/var/runtime/node_modules/aws-sdk/lib/sequential_executor.js:106:20)", " at Request.emit (/var/runtime/node_modules/aws-sdk/lib/sequential_executor.js:78:10)", " at Request.emit (/var/runtime/node_modules/aws-sdk/lib/request.js:686:14)", " at Request.transition (/var/runtime/node_modules/aws-sdk/lib/request.js:22:10)", " at AcceptorStateMachine.runTo (/var/runtime/node_modules/aws-sdk/lib/state_machine.js:14:12)", " at /var/runtime/node_modules/aws-sdk/lib/state_machine.js:26:10", " at Request.<anonymous> (/var/runtime/node_modules/aws-sdk/lib/request.js:38:9)", " at Request.<anonymous> (/var/runtime/node_modules/aws-sdk/lib/request.js:688:12)", " at Request.callListeners (/var/runtime/node_modules/aws-sdk/lib/sequential_executor.js:116:18)" ] }lg...