


 Short description
------------------



This error affects Sqoop version 1.4.7. To resolve the error, download and install the **kite-data-s3-1.1.0.jar**.



 Resolution
-----------



**Note:** The following solution was tested on Amazon EMR release version 5.34.0 and Sqoop version 1.4.7.


1.    [Connect to the master node using SSH](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-kerberos-connect-ssh.html#emr-kerberos-kinit-ssh).


2.    Use **wget** to download the **kite-data-s3-1.1.0.jar**:





```plaintext
[hadoop@ip-xxx-xx-xx-x]$ wget https://repo1.maven.org/maven2/org/kitesdk/kite-data-s3/1.1.0/kite-data-s3-1.1.0.jar
```



3.    Confirm that the downloaded file is the correct size (1.7 MB):





```plaintext
[hadoop@ip-xxx-xx-xx-x]$ du -h
1.7M     /usr/lib/sqoop/lib/kite-data-s3-1.1.0.jar
```



4.    Move the JAR to the Sqoop library directory ( **/usr/lib/sqoop/lib/**):





```plaintext
sudo cp kite-data-s3-1.1.0.jar /usr/lib/sqoop/lib/
```



5.    Grant permission on the JAR:





```plaintext
sudo chmod 755 kite-data-s3-1.1.0.jar
```



6.    Use the **s3n** connector to import the jar. If you use the **s3** connector, you get the **Unknown dataset URI pattern: dataset** error.





```plaintext
sqoop import --connect jdbc:mysql://mysql.cdfqbesrukqe.eu-west-1.rds.amazonaws.com:8193/dev --username admin -P --table hist_root --target-dir "s3n://awsexamplebucket/sqoop_parquet/demo" --as-parquetfile -m 2 --split-by identifiers -- --schema onwatch
```



For more information about the Kite SDK dataset URI, see [Dataset, view, and repository URIs](http://kitesdk.org/docs/1.1.0/URIs.html).





---








I'm trying to use an Amazon EMR cluster to export Amazon Relational Database Service (Amazon RDS) data to Amazon Simple Storage Service (Amazon S3) in Apache Parquet format using Apache Sqoop. I'm using the --as-parquetfile parameter, but I keep getting this error:
"Check that JARs for s3a datasets are on the class path org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI pattern: dataset."

Resolve the "Unknown dataset URI pattern: dataset" error when exporting Amazon RDS data to Amazon S3 using Sqoop

How can I resolve the error "Unknown dataset URI pattern: dataset" when exporting Amazon RDS data to Amazon S3 in Parquet format using Sqoop?

Análisis

¿Por qué aparece el error "HIVE_BAD_DATA: Error parsing field value '' for field X: For input string: """ when I query CSV data in Amazon Athena ("HIVE_BAD_DATA: error al analizar el valor del campo X: para la cadena de entrada """ al consultar datos CSV en Amazon Athena")?

How can I resolve the error "Unknown dataset URI pattern: dataset" when exporting Amazon RDS data to Amazon S3 in Parquet format using Sqoop?

Short description

Resolution

Contenido relevante