Send data from bitbucket pipeline to EC2 instance

Hi,

To keep things simple, why don't you use just S3: you create an additional stage in your pipeline where you push the test data files to S3.

Then, you add some polling mechanism from the EC2 instance ( through extension of existing initial test script or so) to poll the S3 and look for new files. When there are some, the script on EC2 copy them onto the instance file instance for use in next round of tests.

You can sophisticate if you wish by adding a Lambda trigger on the S3 writes by the pipeline to avoid polling from EC2: the Lambda would ssh to EC2 to trigger the copy script. But, that's probably overkill for the current use case that you describe.

Best,

Didier