Questions tagged with High Performance Compute
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
What architecture would one use to design a low latency trading application?
w.r.t: Compute: Serverless vs EC2/ Fargate vs EKS (on EC2 or Fargate)
wr.t. DB/ Caching/ Streams/ Global Accelators/Local...
1
answers
1
votes
1413
views
asked 2 years agolg...
Hello, I am currently benchmarking big data multi-cloud transfer speeds at a range of parallel reads using a cluster of EC2 instances & similar Google machines. I first detected an issue when using a...
1
answers
0
votes
359
views
asked 2 years agolg...
The issue with performance drop when having just a couple of hundreds of connections might be typical to AWS T3 instances. Our server-side Apache modules maintain "sleeping" connections to clients,...
1
answers
0
votes
419
views
asked 2 years agolg...
We are running glue 3.0 jobs with the --enable-auto-scaling set but according to the metrics, the number of active executors is not reduced while it should be according to the number of maximum needed...
2
answers
0
votes
309
views
asked 2 years agolg...
Hi forum,
I'm on AWS and trying to write ~ 1.2mio documents from an AWS Glue 2.0 job Python / pyspark job to an OpenSearch 1.2 "t3.small.search"/SSD cluster.
The issue I'm facing is that after a...
1
answers
0
votes
1696
views
asked 2 years agolg...
Hi,
In my current job, I work in a studio that specializes in 3D and VFX.
Our goal is to render scenes from our pipeline on an AWS virtual machine with the best GPU configuration.
We use the...
1
answers
0
votes
196
views
asked 2 years agolg...
Hello All,
I have deployed an AI model within a Django application, It has just one rest API which activates the AI model. It works perfectly fine for some time but the whole instance stops...
2
answers
0
votes
346
views
asked 2 years agolg...
Hello,
I want to ask if its possible to connect or unify the resources of two or more EC2 instances? Background is that we use heavy machine learning on prem right now and are running into hardware...
2
answers
0
votes
242
views
asked 2 years agolg...
we need to deploy ec2 with following EBS configuration-
random 4k write : 2,00,000 IOPS
sequential read-2000Mb/s
sequential write-2000Mb/s
this is database server requirement.
1. I have some...
1
answers
0
votes
733
views
asked 2 years agolg...
I've been working on some code that would benefit from some level of awareness about the platform on which its running. When it runs on bare metal, several options are available (lshw, hwloc and so...
1
answers
0
votes
1237
views
asked 2 years agolg...
Hi folks,
I'm trying to set the spark executor instances & memory, driver memory and switch of dynamic allocation. What is the correct way to do it?
1
answers
0
votes
1062
views
asked 2 years agolg...
Does using SPOT_CAPACITY _OPTIMIZED launch spot instances into an auto-scaling group in AWS Batch?lg...
I am trying to run multiple jobs in a compute environment using AWS Batch. From my understanding, when there are multiple jobs in a job queue and the allocation strategy is BEST_FIT, AWS Batch will...
0
answers
0
votes
124
views
asked 2 years agolg...