Remove a label from Custom labels in Rekognition - different results?

I have a training and test data set, each with 10 or so labels applied. I created a model on that data. Let's call it Model 1.

Then, I created a new project and used the same data set, but I removed a label by removing it in all images in which it appeared, in both the test and training data. I created a second model, Model 2.

For the labels that remain in both models, however, I get different precision and recall values for labels that I did not change in any way. Does this make sense?