- 最新
- 最多得票
- 最多評論
Hi Tanish,
The maxfilesize
and parallel off
parameters are the two options you have when it comes to limiting the number of files. As you mentioned, parallel off
will increase runtime of the unload, so it is likely not a desirable solution.
I would suggest tweaking the maxfilesize
parameter to get the best output. Keep in mind that each slice in your cluster will create it's own files, so you will be creating at least one file per slice in your cluster, which may be what is introducing the empty files in your unload. Are empty files causing issues with the QuickSight component?
Note you can also change the compression of the output files to further reduce the number of files.
A final point is that QuickSight has the ability to connect directly to Redshift, so if possible in your organisation this may provide better performance and remove the file number problem.
相關內容
- 已提問 10 個月前
- AWS 官方已更新 2 年前
- AWS 官方已更新 2 年前
- AWS 官方已更新 1 年前