COPY from S3 into Redshift Error - The specified key does not exist

Question

I have created a manifest file (named as manifest.json in S3) as
```
{
  "entries": [
    {"url":"s3://bucketname/2024/03/28/", "mandatory":true}]
}
```
The S3 URL is pointing to a folder. This URL works when I tried the COPY company without a manifest file:

```
COPY table
FROM 's3://bucketname/2024/03/28/'
IAM_ROLE 'arn:xxxxx'
DELIMITER '	';
```
However, when I tried to use the manifest file

```
COPY table
from 's3://bucketname/manifest'
IAM_ROLE 'arn:xxxx'
manifest
```
I had errors as:
```
ERROR: Problem reading manifest file - S3ServiceException:The specified key does not exist.,Status 404,Error NoSuchKey
```
Could anyone help with this error? Thanks!

Accepted Answer

Hi there

The manifest file `manifest.json` appears to be located at `s3://bucketname/manifest.json`, but you are specifying the location as `s3://bucketname/manifest` (without the `.json` extension).

To resolve the issue, you need to ensure that the manifest file exists in the correct S3 location and specify the correct location in the `COPY` command, and ensure it has the .manifest extension. Here's how you can modify the `COPY` command:

```

COPY table
FROM 's3://bucketname/manifest.manifest'
IAM_ROLE 'arn:xxxxx'
manifest;
```

Also, your manifest entry is pointing to a prefix, it needs to have an entry to each file to load:

```
{
  "entries": [
    {"url":"s3://bucketname/2024/03/28/file1", "mandatory":true},
    {"url":"s3://bucketname/2024/03/28/file2", "mandatory":true}
  ]
}
```

COPY from S3 into Redshift Error - The specified key does not exist

相关内容