AWS Code Pipeline Failed replicating artifact

I have a build pipeline that has a source of AWS Code Commit. When there is a commit, this runs a build script in AWS Code Build that builds the project artifact. The final stage deploys this artifact into an S3 bucket in a different region which fails with the following error:

Replication of artifact 'BuildArtifact' failed: Failed replicating artifact from bucket 1 in region-1 to bucket 2 in region-2: Check source and destination artifact buckets exist and pipeline role has permission to access it.

According to the logs, the artifact upload is successful but I find no file in none of the buckets. I have tried giving the code pipeline role full access to S3 but didn't change anything. I have also tried re-creating the pipeline (with the same parameters) but this still gives the same error.