Questions tagged with High Performance Compute
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi Dears,
I have a qustion on how to build master EC2 that can communicate with other EC2s based on need and send tasks to them based on a certian code/ group of tasks. Where Master EC2 will take...
2
answers
0
votes
869
views
asked 2 years agolg...
What architecture would one use to design a low latency trading application?
w.r.t: Compute: Serverless vs EC2/ Fargate vs EKS (on EC2 or Fargate)
wr.t. DB/ Caching/ Streams/ Global Accelators/Local...
1
answers
1
votes
1425
views
asked 2 years agolg...
Hello, I am currently benchmarking big data multi-cloud transfer speeds at a range of parallel reads using a cluster of EC2 instances & similar Google machines. I first detected an issue when using a...
1
answers
0
votes
361
views
asked 2 years agolg...
The issue with performance drop when having just a couple of hundreds of connections might be typical to AWS T3 instances. Our server-side Apache modules maintain "sleeping" connections to clients,...
1
answers
0
votes
425
views
asked 2 years agolg...
We are running glue 3.0 jobs with the --enable-auto-scaling set but according to the metrics, the number of active executors is not reduced while it should be according to the number of maximum needed...
2
answers
0
votes
311
views
asked 2 years agolg...
Hi forum,
I'm on AWS and trying to write ~ 1.2mio documents from an AWS Glue 2.0 job Python / pyspark job to an OpenSearch 1.2 "t3.small.search"/SSD cluster.
The issue I'm facing is that after a...
1
answers
0
votes
1702
views
asked 2 years agolg...
Hi,
In my current job, I work in a studio that specializes in 3D and VFX.
Our goal is to render scenes from our pipeline on an AWS virtual machine with the best GPU configuration.
We use the...
1
answers
0
votes
198
views
asked 2 years agolg...
Hello All,
I have deployed an AI model within a Django application, It has just one rest API which activates the AI model. It works perfectly fine for some time but the whole instance stops...
2
answers
0
votes
347
views
asked 2 years agolg...
Hello,
I want to ask if its possible to connect or unify the resources of two or more EC2 instances? Background is that we use heavy machine learning on prem right now and are running into hardware...
2
answers
0
votes
243
views
asked 2 years agolg...
we need to deploy ec2 with following EBS configuration-
random 4k write : 2,00,000 IOPS
sequential read-2000Mb/s
sequential write-2000Mb/s
this is database server requirement.
1. I have some...
1
answers
0
votes
737
views
asked 2 years agolg...
I've been working on some code that would benefit from some level of awareness about the platform on which its running. When it runs on bare metal, several options are available (lshw, hwloc and so...
1
answers
0
votes
1242
views
asked 2 years agolg...
Hi folks,
I'm trying to set the spark executor instances & memory, driver memory and switch of dynamic allocation. What is the correct way to do it?
1
answers
0
votes
1071
views
asked 2 years agolg...