Comprehend Training Set Format

Question

We had a vendor help setup our training set for comprehend custom classification and we are now questions the design.
We know its a csv with class in the first column and text in the second but they design it that each line of text (from textract) should be single quote wrapped and comma delimited. We are questioning should it be one long line of text wrapped in double quotes for the text column of the csv.

Is this Incorrect

Drama, "['Here I am today.', 'Lots of text on lines.', 'Welcome to my example.']"

Is this correct

Drama, "Here I am today. Lots of text on lines. Welcome to my example."

Answer

Hi,

Both the example formats that you provided are correct in the sense that the second column in both of your examples are enclosed within a double quote. As long as you create a valid two-column CSV file format, i.e. label in the first column and text/documents in the second column, you should be fine. However, the fact that both of your examples contain a space after the first column (i.e., 'Drama,') can make the file invalid though. You should avoid having a space after the comma separator. As for your example:

```
Drama, "['Here I am today.', 'Lots of text on lines.', 'Welcome to my example.']"
```

it will be considered as four-column CSV file. Whereas if you remove the space after 'Drama,' as below,

```
Drama,"['Here I am today.', 'Lots of text on lines.', 'Welcome to my example.']"
```

it will be considered as a valid two-column CSV file.

Comprehend Training Set Format

Relevant content