Custom labels programmatically

Hello,

I am trying to upload new training images to an already existing project version using .Net API. So far I uploaded the image via the S3 client to the assets folder of the bucket. But now I am stuck. According to the bucket folder structure the image appears at the same place as the other images, but it doesnt show up in the list of unlabeled images. Being new to all the manifests, I fear that I must add the new images to one of the manifests...

... or is there an API function I am missing or anything else that could help me achieving this?

Hey @HamPeter,

The S3 Sub-Folder for a Dataset is not a live store. To add images to a dataset, you must also modify the corresponding Sagemaker Manifest File. You can think of this manifest file as the "source of truth" for all the annotations and contents of your dataset.

UI-Based

1. Use the in-console GUI to add images to a dataset.

Within the custom labels console, there is a button allowing users to "Add Images". By selecting this button, you can upload images directly into a dataset in batches of 20 at a time. This feature ensures that your images are stored in the correct s3 bucket, automatically handles image name collisions, and updates your dataset directly in s3.

Programmatic

2. Go to the S3 file containing the dataset manifest itself, and append a new "line" in the manifest corresponding to the new images.

You can do this with a simple append operation: cat additional_images.manifest >> output.manifest

After appending your new images, re-upload the output.manifest file to S3 to the same location (creating a new, updated version of that file in the console).

Though this approach is better with large numbers of images, you'll need to handle image-name collisions (dog_image.jpg -> dog_image.jpg), as well as ensuring the images you're adding are stored within the console bucket (due to the Training Service limitations of images from multiple buckets).

If you have any additional questions, please don't hesitate to reach out!

That's great - thank you.