A quick graph of the x and y values of my training data of individuals 1-4 looks like this, where they are all labeled correctly (except for 1 point). Individual1 is near the bottom left, individual 2 is near the top left, etc.
However, when I look at the tracklets, the individuals keep switching.
The switching happens throughout all the frames. How do I fix this?